-- Logs begin at Thu 2022-10-20 05:17:21 UTC, end at Thu 2022-10-20 06:18:48 UTC. -- Oct 20 05:48:26.907888 dv-cinder-861566-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 20 05:48:26.916797 dv-cinder-861566-3-smb devstack@keystone.service[81411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 05:48:26 2022] *** Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: nodename: dv-cinder-861566-3-smb Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: machine: x86_64 Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: clock source: unix Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: pcre jit disabled Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: detected number of CPU cores: 4 Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: current working directory: / Oct 20 05:48:26.918821 dv-cinder-861566-3-smb devstack@keystone.service[81411]: detected binary path: /usr/bin/uwsgi-core Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: your processes number limit is 47680 Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: your memory page size is 4096 bytes Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: detected max file descriptor number: 2048 Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: lock engine: pthread robust mutexes Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: thunder lock: enabled Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 20 05:48:26.919457 dv-cinder-861566-3-smb devstack@keystone.service[81411]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 05:48:26.958815 dv-cinder-861566-3-smb devstack@keystone.service[81411]: Python main interpreter initialized at 0x564c66a619c0 Oct 20 05:48:26.958815 dv-cinder-861566-3-smb devstack@keystone.service[81411]: python threads support enabled Oct 20 05:48:26.958815 dv-cinder-861566-3-smb devstack@keystone.service[81411]: your server socket listen backlog is limited to 100 connections Oct 20 05:48:26.958815 dv-cinder-861566-3-smb devstack@keystone.service[81411]: your mercy for graceful operations on workers is 90 seconds Oct 20 05:48:26.959150 dv-cinder-861566-3-smb devstack@keystone.service[81411]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 05:48:26.959241 dv-cinder-861566-3-smb devstack@keystone.service[81411]: *** Operational MODE: preforking *** Oct 20 05:48:26.959498 dv-cinder-861566-3-smb devstack@keystone.service[81411]: *** uWSGI is running in multiple interpreter mode *** Oct 20 05:48:26.959498 dv-cinder-861566-3-smb devstack@keystone.service[81411]: spawned uWSGI master process (pid: 81411) Oct 20 05:48:26.959698 dv-cinder-861566-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 20 05:48:26.963499 dv-cinder-861566-3-smb devstack@keystone.service[81411]: spawned uWSGI worker 1 (pid: 81424, cores: 1) Oct 20 05:48:26.963499 dv-cinder-861566-3-smb devstack@keystone.service[81411]: spawned uWSGI worker 2 (pid: 81425, cores: 1) Oct 20 05:48:26.963499 dv-cinder-861566-3-smb devstack@keystone.service[81411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 05:48:31.242472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:48:31.242472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: from cryptography.utils import int_from_bytes Oct 20 05:48:31.243760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:48:31.243760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: from cryptography.utils import int_from_bytes Oct 20 05:48:31.246666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:48:31.246666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: from cryptography.utils import int_from_bytes Oct 20 05:48:31.247135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:48:31.247135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: from cryptography.utils import int_from_bytes Oct 20 05:48:31.293446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 05:48:31.293635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 05:48:31.293853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] command line args: [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 05:48:31.294123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 05:48:31.294299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ================================================================================ {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 05:48:31.294555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] admin_token = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.294800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] config_dir = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.294987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.295167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] config_source = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.295342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] debug = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.295537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.295844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 05:48:31.295844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 05:48:31.296052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.296153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] command line args: [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 05:48:31.296254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.296348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 05:48:31.296451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.296559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ================================================================================ {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 05:48:31.296654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.296748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] admin_token = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.296841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.296935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] config_dir = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_config_append = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] config_source = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_dir = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] debug = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_file = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.297999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.298875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_config_append = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_dir = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_file = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.299994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.300820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] publish_errors = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.301933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] standard_threads = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.302973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] publish_errors = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] use_journal = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.303976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] use_json = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] use_stderr = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] use_syslog = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.304883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.305068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.305681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] standard_threads = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.305836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.305923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.306204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.306293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.306430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.306576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] use_journal = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.306721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] use_json = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] use_stderr = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.306925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] use_syslog = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.306993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:48:31.307139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.307865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.308980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.309969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.310996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.311925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.312863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.313984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.314973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.315895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316807 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.316953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.317971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318122 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.318891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.319983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.320784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.321519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.321730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.321903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322077 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.322973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323604 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.323918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.324910 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.325981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.326929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.327918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.328971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.329947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330184 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.external = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.330955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.password = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331803 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] auth.token = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.331907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.332975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.external = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.333944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.password = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] auth.token = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.334983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.335933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.336096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.336174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.336387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.336550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.336654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.336905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337589 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.337929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.338890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.339858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340568 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.340977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.341941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.342951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.343971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.344850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.345952 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.346900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.347977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.348957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.349901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350842 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.350994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.351790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.352462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.352551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.352792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.352871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.353965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.354991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.355915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.356860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.357989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.358918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.359947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.360878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.361840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.362962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.363924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] role.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] role.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.364941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.365993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.366877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.367932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.368198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.368347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.368488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.368621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] role.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.368812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] role.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.368941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.369899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.370949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.371980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.372981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.373909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.374930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.375973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.376898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.377988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.connection = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.378882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.379907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.380959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.381949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382330 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.connection = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 05:48:31.382698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.382698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.383000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.383000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.383723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.384375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.384634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.384882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.385139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.385385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.385636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.385896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.386144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.386383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:48:31.386820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 05:48:31.412909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.413137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.413360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.413666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.413929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.414155 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.421763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.423017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.450065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.450289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.452058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.452290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.503714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.504382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.552970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.553199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.554660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.554897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.708464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.708734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.708871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.709987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.732150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.732376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.732600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.732798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.732973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.733773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.734011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.734135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.745002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.745931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.757380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.757568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.757697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.757858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.757988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.758113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.758464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.758644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.758644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.758943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.759070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.759195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.759319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.759534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 05:48:31.775919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.776125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 05:48:31.776463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.776661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 05:48:31.776975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.777234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.777493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.777809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.781621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.781859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 05:48:31.782203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.782404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 05:48:31.782678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.782973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.783394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.783777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.787413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.787689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.787958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.788242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.794183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.794464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.794739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.795026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.795742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.799124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.799408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.799693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.799977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.800261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.800529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.800799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.801074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.801344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.801616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.801909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.801995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.804851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.805206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.805541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.805855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.806144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.806408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.806678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.806951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.807224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.807500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.807769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.824484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.825964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.826245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.830358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.831003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.831286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.831568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.831818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.832103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.837281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.837541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.837844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.838413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.838696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.844314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.844400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.844599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.844694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.844880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.845160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.845432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.845706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.845996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.846262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.850284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.850584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.850879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.851170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.851453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.851735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.852575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.853014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.862223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.862496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.866273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.868470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.868750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.869601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.869926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.872559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.874071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.875732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.876031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.877107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.880159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.880246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.880526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.880815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.881097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.881372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.881653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.883273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.886913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.887215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.887500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.887782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.888058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.888335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.897425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.897710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.898002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.898258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.904454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.904744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.905015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.905282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.905519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.907156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.908665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.908938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.911774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.912058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.912140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.912349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.912629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.913020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.913621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.915511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.915789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.918462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.918749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.919049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.919369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.919791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.924311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.924594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.924876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.925154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.925529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.925844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.926125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.931420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.931704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.931982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.932268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.932648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.932927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.933206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.942308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.945188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.948615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.949039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.950076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.951527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.951805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.951964 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.952212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.954879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.956326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.957928 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.958214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.958509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.958595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.959988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.962930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.963325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.963608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.963888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.965214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.966707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.969549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.969967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.970268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.970550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.971619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.971912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.972191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.978459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.978748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.979026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.980911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.981491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.981491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.981658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.981955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.982212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.982479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.982766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.985905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 05:48:31.986184 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.986464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.986737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.987020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.987293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.987564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.987846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.988125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.988394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.988663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.988938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.989203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:31.989461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 05:48:32.017921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c66a619c0 pid: 81425 (default app) Oct 20 05:48:32.021186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cadb5c-84cf-47f8-b09f-5e6efdb8ccd3 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:32.021472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cadb5c-84cf-47f8-b09f-5e6efdb8ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:32.021771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cadb5c-84cf-47f8-b09f-5e6efdb8ccd3 None None] PATH_INFO: `/v3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:32.025797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c66a619c0 pid: 81424 (default app) Oct 20 05:48:32.025989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Oct 20 05:48:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:38.806768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:38.807284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:38.807391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:38.811593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:48:38.817356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:38.817936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:38.817936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:38.890463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: INFO dbcounter [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] Registered counter for database keystone Oct 20 05:48:38.909600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG oslo_db.sqlalchemy.engines [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:48:38.916770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writer thread running {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:48:39.098743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG passlib.handlers.bcrypt [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81425) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 05:48:39.099061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG passlib.handlers.bcrypt [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81425) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 05:48:39.158380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:39.159991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:39.290652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 20 05:48:39.731899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:39.801397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: INFO dbcounter [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] Registered counter for database keystone Oct 20 05:48:39.822929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG oslo_db.sqlalchemy.engines [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:48:39.829057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writer thread running {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:48:39.947403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c48e3-f34a-4fa3-80fb-3f8b09ebf0c0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:39.951561 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:39.952179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:39.952454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:39.952723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:39.962709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:40.014380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 05:48:40.014665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c918936-d743-4135-adc0-ae21bb6cbe96 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:40.024432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Oct 20 05:48:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 05:48:40.030207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:40.047060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44959-2ce4-4f3f-bd37-8eb6367bf3e9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:40.051565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:40.052672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:40.052953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:40.053232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] PATH_INFO: `/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:40.054843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] RBAC: Authorizing `identity:get_project(project_id=34e0c1ea686742ad9b5478d4dbdbb4cc)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:40.107636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 05:48:40.108024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdad67b-514b-4fdc-b77f-d303491b597f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:40.112467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 05:48:40 2022] GET /identity/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:42.277650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e867-087d-4ca7-a479-3914d077b68b None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:42.278234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e867-087d-4ca7-a479-3914d077b68b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:42.278234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e867-087d-4ca7-a479-3914d077b68b None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:42.282287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:42.287715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:42.288137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:42.288261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:42.308466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:42.309989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:42.317614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 05:48:42.586499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e867-087d-4ca7-a479-3914d077b68b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:42.599081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e867-087d-4ca7-a479-3914d077b68b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:42.604272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c22f08-0a99-49c4-a85c-b60cb1eed56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:42.604869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22f08-0a99-49c4-a85c-b60cb1eed56f admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:42.605148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22f08-0a99-49c4-a85c-b60cb1eed56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:42.605421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22f08-0a99-49c4-a85c-b60cb1eed56f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:42.612929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c22f08-0a99-49c4-a85c-b60cb1eed56f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:42.615040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c22f08-0a99-49c4-a85c-b60cb1eed56f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:42.624483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Oct 20 05:48:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 05:48:42.629911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:42.639718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa2d5-d4fa-4fab-8fdb-23a25538f68d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:42.643960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c709-39c3-4d17-a4ab-ea70908b390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:42.644580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c709-39c3-4d17-a4ab-ea70908b390c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:42.644856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c709-39c3-4d17-a4ab-ea70908b390c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:42.645123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c709-39c3-4d17-a4ab-ea70908b390c admin admin] PATH_INFO: `/v3/users/b0376d5185ac4115b7c02b4f3223cf16` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:42.646429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90c709-39c3-4d17-a4ab-ea70908b390c admin admin] RBAC: Authorizing `identity:get_user(user_id=b0376d5185ac4115b7c02b4f3223cf16)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:42.648235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90c709-39c3-4d17-a4ab-ea70908b390c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:42.650429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Oct 20 05:48:42 2022] GET /identity/v3/users/b0376d5185ac4115b7c02b4f3223cf16 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:44.877461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fba5b1-76f6-43f9-9e92-72711be6360f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:44.878037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fba5b1-76f6-43f9-9e92-72711be6360f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:44.878037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fba5b1-76f6-43f9-9e92-72711be6360f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:44.879507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:44.885164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:44.885588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:44.885845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:44.903963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:44.905121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:44.940821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec9fc-6cc5-48ea-a17f-7483d43a2d96 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:44.941110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec9fc-6cc5-48ea-a17f-7483d43a2d96 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:44.941387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec9fc-6cc5-48ea-a17f-7483d43a2d96 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:44.942907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:48:44.948249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:44.948532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:44.948806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:44.987620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:44.991616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG passlib.handlers.bcrypt [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81424) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 05:48:44.992004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG passlib.handlers.bcrypt [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81424) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 05:48:45.041951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:45.043531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:45.141828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:48:45.256635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.280716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:45.360631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536f625-506f-4050-8659-0fad6c39d3e7 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.393336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.393932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.394209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.394479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.405890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:48:45.407138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:48:45.414737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:48:45.415958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:48:45.417225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:48:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:48:45.421438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.501790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:45.504894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb8837-fd8a-4416-9eaf-9628666b3ddf None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.509528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:45.520629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c14a-a6bb-4fc4-a529-fdd161f73183 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.546239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.547114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.547396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.547672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.548648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:45.550100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:45.554035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.554643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.554921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.555194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.556376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:48:45.556679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:45.558069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:45.561917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.sql.core [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 05:48:45.561917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 05:48:45.561917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [parameters: {'id': '17e23119d02e44558dcbc27820b25103', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 05:48:45.561917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 05:48:45.569713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:48:45.575738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:48:45.581069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 05:48:45.582042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application yield resource Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise self.value Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application session.commit() Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 05:48:45.583152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.flush() Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application compat.raise_( Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 05:48:45.584214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 05:48:45.585628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:48:45.586960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [parameters: {'id': '17e23119d02e44558dcbc27820b25103', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 05:48:45.588086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:48:45.589300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1137 bytes} [Thu Oct 20 05:48:45 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:48:45.590442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.680254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661819c-6e4a-434a-944d-b51f2da29468 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.691211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c66e7-1469-43b7-835e-f2fac83b60e1 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.714027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.714652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.714931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.715208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] PATH_INFO: `/v3/users/b0376d5185ac4115b7c02b4f3223cf16` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.716327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] RBAC: Authorizing `identity:get_user(user_id=b0376d5185ac4115b7c02b4f3223cf16)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:45.717806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:45.719346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:48:45 2022] GET /identity/v3/users/b0376d5185ac4115b7c02b4f3223cf16 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:48:45.724713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.726008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.726853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.727157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.727451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.740035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:45.745971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:45.747454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:48:45.764477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:48:45.765413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:48:45.766244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:48:45.766244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:48:45.766244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:45.766244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:48:45.771319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.793249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:45.825581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ccc7-916d-4d54-99d3-e76ee393c139 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.860728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.861355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.861642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.861950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.863108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:45.864557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:45.866128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:48:45.871622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:45.876031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ce26-d5eb-4d7b-91d5-43a76a055124 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:45.914199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:45.915339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:45.915682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:45.915967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:45.916647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:48:45.916950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:45.918384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b902-fe59-47ca-9823-f29064bab19e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:45.935300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:48:45.953692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:45.975968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068ebc-a4a3-449c-b70c-39d95f3b8293 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:46.014421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18b10-74f1-45dd-accf-3851c27a662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:46.015092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18b10-74f1-45dd-accf-3851c27a662a None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:46.015366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18b10-74f1-45dd-accf-3851c27a662a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:46.015636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18b10-74f1-45dd-accf-3851c27a662a None admin] PATH_INFO: `/v3/domains/default/users/b0376d5185ac4115b7c02b4f3223cf16/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:46.017609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18b10-74f1-45dd-accf-3851c27a662a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b0376d5185ac4115b7c02b4f3223cf16, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:46.019085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18b10-74f1-45dd-accf-3851c27a662a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:46.135198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Oct 20 05:48:45 2022] PUT /identity/v3/domains/default/users/b0376d5185ac4115b7c02b4f3223cf16/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:48:48.616912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a437-9b66-4234-8586-f36c6ec1fb00 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:48.617444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a437-9b66-4234-8586-f36c6ec1fb00 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:48.617516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a437-9b66-4234-8586-f36c6ec1fb00 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:48.619115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:48.625127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135125e8-0121-437f-9594-a6c0e7b20149 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:48.626067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135125e8-0121-437f-9594-a6c0e7b20149 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:48.626536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135125e8-0121-437f-9594-a6c0e7b20149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:48.654872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-135125e8-0121-437f-9594-a6c0e7b20149 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:48.656756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-135125e8-0121-437f-9594-a6c0e7b20149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:48.670729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7986-7ca4-472e-ad6d-d7d2d01db34d None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:48.671330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7986-7ca4-472e-ad6d-d7d2d01db34d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:48.671793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7986-7ca4-472e-ad6d-d7d2d01db34d None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:48.673284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:48:48.678953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb68cbc-b916-437f-8f3e-56443849385d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:48.679235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb68cbc-b916-437f-8f3e-56443849385d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:48.679514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb68cbc-b916-437f-8f3e-56443849385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:48.710822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-dcb68cbc-b916-437f-8f3e-56443849385d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:48.712839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dcb68cbc-b916-437f-8f3e-56443849385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:48.832228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:48.856316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:48:49.220159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ae81-158d-4d3f-9e14-82d59fd0a518 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.220527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ae81-158d-4d3f-9e14-82d59fd0a518 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.220716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ae81-158d-4d3f-9e14-82d59fd0a518 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.225241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:48:49.226708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f29de8-12c3-4a67-91a6-fdce02ef795f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.226998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f29de8-12c3-4a67-91a6-fdce02ef795f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.227414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f29de8-12c3-4a67-91a6-fdce02ef795f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.228920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:49.234601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.234827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.235103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.239001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.239289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.239566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.270860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:49.271700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:49.272079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:49.272865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:49.278136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:49.352981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:49.355114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:49.356059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:49.357726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:49.359038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:49.483280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773d99-5605-49fb-8031-cb35243b50aa None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:49.519456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:49.520022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.520305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.520581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.530516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:49.534312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:48:49.542306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:48:49.543208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:48:49.543949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:48:49.549034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:49.589397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fea122-5ab3-4fb0-af9e-8d825b599005 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:49.657818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6fe81-5efe-4375-be1a-eb7c32769170 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:49.698995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:49.700273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.700769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.701242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.702161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:49.703868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:49.716160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:49.716830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.717117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.717455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.719000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:48:49.719000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:49.720176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816788fc-62d3-4be2-8ba6-92be04008727 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:49.739321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:48:49.740642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4990-6b3b-4d65-b91f-d7e1b29712d0 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.740934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4990-6b3b-4d65-b91f-d7e1b29712d0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.741209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4990-6b3b-4d65-b91f-d7e1b29712d0 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.742423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 18/32] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:49.743695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4990-6b3b-4d65-b91f-d7e1b29712d0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:49.745419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 05:48:49 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:48:49.746491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:49.846824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:49.850584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:49.900771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4990-6b3b-4d65-b91f-d7e1b29712d0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:49.904784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d0c32-be25-4e3f-8a84-6e4ccb8e5349 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:49.947114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:49.948305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.948871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.949400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.950574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:49.950679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d1bf1-addc-4022-af31-72a8b723ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:49.951300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d1bf1-addc-4022-af31-72a8b723ef4a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.951583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d1bf1-addc-4022-af31-72a8b723ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.951857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d1bf1-addc-4022-af31-72a8b723ef4a None admin] PATH_INFO: `/v3/users/b0376d5185ac4115b7c02b4f3223cf16` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.953047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d1bf1-addc-4022-af31-72a8b723ef4a None admin] RBAC: Authorizing `identity:get_user(user_id=b0376d5185ac4115b7c02b4f3223cf16)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:49.953285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:49.954564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d1bf1-addc-4022-af31-72a8b723ef4a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:49.956194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 16/34] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:48:49 2022] GET /identity/v3/users/b0376d5185ac4115b7c02b4f3223cf16 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:49.957375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:49.957670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:49.957959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:49.987449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:49.988869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:50.070476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:50.077765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:50.096002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 05:48:49 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:48:50.097137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:50.138188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:50.197655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7640-dc83-4f5e-a2be-11de8d8e8767 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:50.256065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:50.256699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.256985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.257262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.278678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:50.280222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:50.299339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e589ff-d3d4-48ed-ad82-a8e6bb1811f6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:48:50.311056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:48:50.311987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:48:50.312793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:48:50.312793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:48:50.312793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:48:50.312793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 18/37] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:48:50.326294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:50.349920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:50.366108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:50.366771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.367086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.367365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.368754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:50.370368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:50.371989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:50.379726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:50.465018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0ca9c-7d75-4156-a998-b09bfdc7c810 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:50.476097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:50.498579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ff269-a15d-423a-884d-5d08359683be None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:50.500455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:50.501072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.501354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.501631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.502313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:48:50.502621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:50.504019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:50.521996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 19/39] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:50.522786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:50.532697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:50.533305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.533585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.533894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.534630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.domain.id=default, user.id=b0376d5185ac4115b7c02b4f3223cf16) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:48:50.534940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:50.536377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e798ddb-e0ad-4113-88a4-1489a9ff6798 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:50.544888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 21/40] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Oct 20 05:48:50 2022] GET /identity/v3/role_assignments?user.id=b0376d5185ac4115b7c02b4f3223cf16&scope.domain.id=default&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:50.546171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdac99-0ea1-4eaf-a1c9-9d4cc64b6f6a None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.546456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdac99-0ea1-4eaf-a1c9-9d4cc64b6f6a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.546729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdac99-0ea1-4eaf-a1c9-9d4cc64b6f6a None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.548073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 22/41] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:50.549338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdac99-0ea1-4eaf-a1c9-9d4cc64b6f6a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:50.620187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:50.646422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024efe-c4d7-49ad-aa5f-540d405afe92 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:50.670408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdac99-0ea1-4eaf-a1c9-9d4cc64b6f6a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:50.684396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a6d90-407f-4a6d-b27c-10cc3ad2fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:50.685020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6d90-407f-4a6d-b27c-10cc3ad2fb9d None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.685303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6d90-407f-4a6d-b27c-10cc3ad2fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.685578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6d90-407f-4a6d-b27c-10cc3ad2fb9d None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.686459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a6d90-407f-4a6d-b27c-10cc3ad2fb9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:50.688001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a6d90-407f-4a6d-b27c-10cc3ad2fb9d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:50.705373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 20/42] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 05:48:50 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:48:50.709411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:50.710145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.710451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.710701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.711372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:50.713659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:50.715679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:50.716052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:50.716775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:50.752116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 23/43] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:48:50 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:48:50.851250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:50.852679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:50.881405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:50.934441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 21/44] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:51.204850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:51.302400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3c1a-b5a7-4dce-a4e6-130a6c50edef None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:51.309141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:51.336127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d90d0-6b12-4848-b742-7c1396f93bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:51.337263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d90d0-6b12-4848-b742-7c1396f93bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:51.337544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d90d0-6b12-4848-b742-7c1396f93bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:51.337856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d90d0-6b12-4848-b742-7c1396f93bb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:51.338971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d90d0-6b12-4848-b742-7c1396f93bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:51.340432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d90d0-6b12-4848-b742-7c1396f93bb7 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:51.342018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 24/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:51.347548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:51.444276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933946cf-c194-4dad-8fc8-09d57589e594 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:51.477186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17104c96-9e1f-4977-be14-aa64e77ffc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:51.477803 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17104c96-9e1f-4977-be14-aa64e77ffc53 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:51.478092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17104c96-9e1f-4977-be14-aa64e77ffc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:51.478365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17104c96-9e1f-4977-be14-aa64e77ffc53 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:51.479010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17104c96-9e1f-4977-be14-aa64e77ffc53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:51.480457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17104c96-9e1f-4977-be14-aa64e77ffc53 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:51.507010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:48:51 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:48:53.646652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d351-18e2-4a24-8ed0-68079fee6ad5 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:53.647175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d351-18e2-4a24-8ed0-68079fee6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:53.647262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d351-18e2-4a24-8ed0-68079fee6ad5 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:53.648529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:53.653976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:53.654373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:53.654541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:53.672639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:53.673859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:53.681824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:53.739805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:48:54.012212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d351-18e2-4a24-8ed0-68079fee6ad5 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:54.110105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d351-18e2-4a24-8ed0-68079fee6ad5 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:54.142072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369642-b6c6-4716-8397-3c5f5fb49497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:54.142687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369642-b6c6-4716-8397-3c5f5fb49497 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:54.142965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369642-b6c6-4716-8397-3c5f5fb49497 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:54.143239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369642-b6c6-4716-8397-3c5f5fb49497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:54.144332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369642-b6c6-4716-8397-3c5f5fb49497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:54.145808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369642-b6c6-4716-8397-3c5f5fb49497 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:54.147320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:54.152849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:54.248329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f8db9-5b08-469e-a370-479abea0fab8 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:54.281004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29d9f-993a-40a9-ad71-9b5364fe0dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:54.281606 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29d9f-993a-40a9-ad71-9b5364fe0dbb None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:54.281917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29d9f-993a-40a9-ad71-9b5364fe0dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:54.282197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29d9f-993a-40a9-ad71-9b5364fe0dbb None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:54.282846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29d9f-993a-40a9-ad71-9b5364fe0dbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:54.284290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29d9f-993a-40a9-ad71-9b5364fe0dbb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:54.298766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:54.309909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 24/50] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Oct 20 05:48:54 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:48:56.455403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255b14f-81c5-44c8-823b-2e7392021b6b None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:56.455927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255b14f-81c5-44c8-823b-2e7392021b6b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:56.455927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255b14f-81c5-44c8-823b-2e7392021b6b None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:56.457263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 27/51] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:48:56.463106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:56.463521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:56.463646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:56.481281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:48:56.482465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:48:56.545671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 25/52] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:48:56.819006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255b14f-81c5-44c8-823b-2e7392021b6b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:56.966778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:57.023980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255b14f-81c5-44c8-823b-2e7392021b6b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:57.057430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8cc55-4fd3-415a-a4ac-cca8133faa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:57.058085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cc55-4fd3-415a-a4ac-cca8133faa09 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:57.058371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cc55-4fd3-415a-a4ac-cca8133faa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:57.058648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cc55-4fd3-415a-a4ac-cca8133faa09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:57.059761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8cc55-4fd3-415a-a4ac-cca8133faa09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:57.061213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8cc55-4fd3-415a-a4ac-cca8133faa09 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:57.062801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:48:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:48:57.068374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:48:57.165392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65a734-9005-494a-b207-6095accf4ad9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:48:57.189629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:48:57.200811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25920206-f255-4718-9a28-65b1ad9223ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:48:57.201424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920206-f255-4718-9a28-65b1ad9223ca None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:48:57.201708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920206-f255-4718-9a28-65b1ad9223ca None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:48:57.202021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920206-f255-4718-9a28-65b1ad9223ca None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:48:57.202680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25920206-f255-4718-9a28-65b1ad9223ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:48:57.204125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25920206-f255-4718-9a28-65b1ad9223ca None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:48:57.232049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 26/54] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:48:57 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:00.465089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e4850-1bac-4056-999c-f7316a6a3352 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:00.466113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e4850-1bac-4056-999c-f7316a6a3352 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:00.466619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e4850-1bac-4056-999c-f7316a6a3352 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:00.468162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 29/55] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:00.473612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8dcac-708b-47bb-b9be-1f5f200c9f09 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:00.474480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8dcac-708b-47bb-b9be-1f5f200c9f09 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:00.474956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8dcac-708b-47bb-b9be-1f5f200c9f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:00.502989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-16b8dcac-708b-47bb-b9be-1f5f200c9f09 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:00.504575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-16b8dcac-708b-47bb-b9be-1f5f200c9f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:00.598072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 27/56] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:00.627359 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c95470-c5c9-4e83-bfee-5a1d9e8779ec None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:00.627963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c95470-c5c9-4e83-bfee-5a1d9e8779ec None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:00.628452 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c95470-c5c9-4e83-bfee-5a1d9e8779ec None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:00.630007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 30/57] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:00.636168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbacaa-00ff-41a0-a4a2-dcc83fb5510b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:00.636679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbacaa-00ff-41a0-a4a2-dcc83fb5510b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:00.637181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbacaa-00ff-41a0-a4a2-dcc83fb5510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:00.667160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2edbacaa-00ff-41a0-a4a2-dcc83fb5510b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:00.668695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2edbacaa-00ff-41a0-a4a2-dcc83fb5510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:00.747930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 28/58] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:00.869542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c7eed-5fb6-4e49-b64f-b491c10af7a9 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:00.870224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c7eed-5fb6-4e49-b64f-b491c10af7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:00.870705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c7eed-5fb6-4e49-b64f-b491c10af7a9 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:00.872223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 31/59] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:00.877238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:00.877525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:00.877827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:00.902010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:00.903183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:00.906326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c7eed-5fb6-4e49-b64f-b491c10af7a9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:00.981207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.053408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 29/60] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:01.058626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c7eed-5fb6-4e49-b64f-b491c10af7a9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.074091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.085921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.127013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac8c8-7aae-4345-b050-d89ca0f04b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.127979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac8c8-7aae-4345-b050-d89ca0f04b36 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.128256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac8c8-7aae-4345-b050-d89ca0f04b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.128526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac8c8-7aae-4345-b050-d89ca0f04b36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.148015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ac8c8-7aae-4345-b050-d89ca0f04b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-a94ac8c8-7aae-4345-b050-d89ca0f04b36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:01.153782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:01.154885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:01.155743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 32/61] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:01.156616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8d5e-f009-4913-8e08-ba19e9f092b7 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.157054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8d5e-f009-4913-8e08-ba19e9f092b7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.157339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8d5e-f009-4913-8e08-ba19e9f092b7 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.158603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 33/62] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:01.163644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8d5e-f009-4913-8e08-ba19e9f092b7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.240015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06516274-bd09-4aa8-87db-725961a28b65 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.271476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8d5e-f009-4913-8e08-ba19e9f092b7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.282199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4b350-67b4-431b-9ef7-db57370fdd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.282839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b350-67b4-431b-9ef7-db57370fdd6b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.283126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b350-67b4-431b-9ef7-db57370fdd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.283397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b350-67b4-431b-9ef7-db57370fdd6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.294618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4b350-67b4-431b-9ef7-db57370fdd6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-27b4b350-67b4-431b-9ef7-db57370fdd6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:01.299533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:01.300380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:01.301148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 30/63] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:01.302679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.302679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.302797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.313293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.313878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.314163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.314438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.315106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:01.315410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:01.316798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5dfb-f5fe-4e82-a6f5-0fdfe7c86104 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:01.320379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:01.321648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:01.330227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 34/64] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:01.330227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc4393-7628-4e72-81cf-d46d7ce145e4 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.330227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc4393-7628-4e72-81cf-d46d7ce145e4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.330227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc4393-7628-4e72-81cf-d46d7ce145e4 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.330227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 35/65] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:01.330227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc4393-7628-4e72-81cf-d46d7ce145e4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.352370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.368457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.396100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 31/66] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:01.401480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.441812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc4393-7628-4e72-81cf-d46d7ce145e4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.477025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.477718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.478151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.478256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.478878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:01.479185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:01.480563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e995a6-169e-45d0-a454-ff7a8f56e5c9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:01.488791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 36/67] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:01.490000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.490290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.490566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.508596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a03c51-967d-4e59-944f-ae68b97434dd None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.510311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:01.512777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:01.546186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.546827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.547110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.547386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] PATH_INFO: `/v3/users/ce00856f249a4350b173240c06edfe65` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.562444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=ce00856f249a4350b173240c06edfe65)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:01.564119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:01.565943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 32/68] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/users/ce00856f249a4350b173240c06edfe65 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:01.571018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.581005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:01.582726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.594035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.614200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.694207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aab3c-2c85-444b-b68f-3c85c843cfa4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.700995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8328-f355-4de0-8b71-af1814059f6d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.729111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.729770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.730047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.730395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.737332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.737997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.738280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.738556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] PATH_INFO: `/v3/users/ce00856f249a4350b173240c06edfe65` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.739931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] RBAC: Authorizing `identity:get_user(user_id=ce00856f249a4350b173240c06edfe65)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:01.740547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:01.741379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:01.742991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 38/70] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/users/ce00856f249a4350b173240c06edfe65 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:01.744505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:01.746350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:01.747221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 33/71] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:01.750720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.837291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.848971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:01.859383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33ad6d-a39d-44f7-a293-0fd1659b5bdf None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.860559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bfec4-b0ab-4bf1-9cab-c119b70b8fe5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:01.894100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.894735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.894938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:01.895052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.895279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.895558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:01.895836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:01.896110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:01.896416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:01.897254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:01.897913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:01.898707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:01.899688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 39/72] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:01.904701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 34/73] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:01.904701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:01.904867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.000697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cc6eb-2cb1-4117-9261-a49fe7f7524c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.004495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ace2-8846-4408-92a7-d41d04919dc2 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.034673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.035275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.035551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.035819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.036475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:02.036775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.037837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.038190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.038462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.038744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.039020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.040221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.041680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.043324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 40/74] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:02.044188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.046540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 35/75] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:02.047536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.058752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.079252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.148393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad2f4e-b357-47a5-bda2-3e8ee158031d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.149510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef6b6-0895-45d0-8eaf-acdd9f405dff None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.182915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.183565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.183666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.183845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.184120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619/users/ce00856f249a4350b173240c06edfe65/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.184227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.184512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.184789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.186051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] RBAC: Authorizing `identity:create_grant(project_id=921d232f84fb4aba890912996255f619, user_id=ce00856f249a4350b173240c06edfe65, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.187512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.195417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:02.200204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 36/76] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:02 2022] PUT /identity/v3/projects/921d232f84fb4aba890912996255f619/users/ce00856f249a4350b173240c06edfe65/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:02.201061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:02.202115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:02.202890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 41/77] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:02.203529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.203709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.289830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.316532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.328953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfb32b-c898-4bb9-a500-0917e62bffdd None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.334523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c358d9b-a6c7-4d7b-b816-f0921ecaf365 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.366557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.367178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.367462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.367744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.368529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.370533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.376170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.376441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.376719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.376988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619/users/ce00856f249a4350b173240c06edfe65/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.379681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] RBAC: Authorizing `identity:create_grant(project_id=921d232f84fb4aba890912996255f619, user_id=ce00856f249a4350b173240c06edfe65, role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.381038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.394264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 37/78] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:02 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:02.395420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.406999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 42/79] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:02 2022] PUT /identity/v3/projects/921d232f84fb4aba890912996255f619/users/ce00856f249a4350b173240c06edfe65/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:02.408240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.586626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b28d71-632c-4a9b-9304-a7d27b6679ce None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.626522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf226c-24fd-44bb-b02c-2a835faaa0d0 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.633948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.634585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.634887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.635147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.636511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:02.636511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.637645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.651891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 43/80] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:02.657592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.659144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.673967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.681823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.683404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.683696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.683998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] PATH_INFO: `/v3/users/b0376d5185ac4115b7c02b4f3223cf16` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.686759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] RBAC: Authorizing `identity:get_user(user_id=b0376d5185ac4115b7c02b4f3223cf16)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.688434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.690293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 38/81] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:02 2022] GET /identity/v3/users/b0376d5185ac4115b7c02b4f3223cf16 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:02.698448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.792913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc0a01-eddd-44e0-b84f-05d0efecc98a None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.830413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.831109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.831398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.831973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] PATH_INFO: `/v3/users/ce00856f249a4350b173240c06edfe65` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.832915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] RBAC: Authorizing `identity:get_user(user_id=ce00856f249a4350b173240c06edfe65)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.834440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.835362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b617-4720-4eb5-a61c-120fa55c4a6d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:02.836081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 44/82] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:02 2022] GET /identity/v3/users/ce00856f249a4350b173240c06edfe65 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:02.843696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.894962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:02.895606 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:02.895988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:02.896268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:02.898984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:02.900766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:02.902731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 39/83] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:02 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:02.908465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:02.935337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:02.959329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47dc1-0e00-4b57-a7cf-4dabec9c2b2a None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:03.005220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:03.006998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:03.007284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:03.007561 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] PATH_INFO: `/v3/projects/efa13a41d8af49618db1d3ea628bb73a` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:03.009653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] RBAC: Authorizing `identity:get_project(project_id=efa13a41d8af49618db1d3ea628bb73a)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:03.011343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:03.013267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 45/84] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:02 2022] GET /identity/v3/projects/efa13a41d8af49618db1d3ea628bb73a => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:03.021672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:03.042208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:03.123307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446ead-0453-4a63-ad9a-b8a7a1fd39c6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:03.172944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3de29-bb39-4c06-aa39-58643a9bf76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:03.173718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3de29-bb39-4c06-aa39-58643a9bf76c None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:03.174029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3de29-bb39-4c06-aa39-58643a9bf76c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:03.174763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3de29-bb39-4c06-aa39-58643a9bf76c None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619/users/b0376d5185ac4115b7c02b4f3223cf16/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:03.178996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3de29-bb39-4c06-aa39-58643a9bf76c None admin] RBAC: Authorizing `identity:create_grant(project_id=921d232f84fb4aba890912996255f619, user_id=b0376d5185ac4115b7c02b4f3223cf16, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:03.180501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3de29-bb39-4c06-aa39-58643a9bf76c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:03.208915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:02 2022] PUT /identity/v3/projects/921d232f84fb4aba890912996255f619/users/b0376d5185ac4115b7c02b4f3223cf16/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:03.218392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8ecc-06c3-4756-b84c-7c0944958a68 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:03.261851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac24787-6f85-406d-af98-ab27ee8d3012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:03.262533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac24787-6f85-406d-af98-ab27ee8d3012 None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:03.262817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac24787-6f85-406d-af98-ab27ee8d3012 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:03.263360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac24787-6f85-406d-af98-ab27ee8d3012 None admin] PATH_INFO: `/v3/projects/efa13a41d8af49618db1d3ea628bb73a/users/ce00856f249a4350b173240c06edfe65/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:03.266980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac24787-6f85-406d-af98-ab27ee8d3012 None admin] RBAC: Authorizing `identity:create_grant(project_id=efa13a41d8af49618db1d3ea628bb73a, user_id=ce00856f249a4350b173240c06edfe65, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:03.268767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac24787-6f85-406d-af98-ab27ee8d3012 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:03.289557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 46/86] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:03 2022] PUT /identity/v3/projects/efa13a41d8af49618db1d3ea628bb73a/users/ce00856f249a4350b173240c06edfe65/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:05.470673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65153286-77b0-479a-8d30-6399e61dcff2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.471183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65153286-77b0-479a-8d30-6399e61dcff2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.471255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65153286-77b0-479a-8d30-6399e61dcff2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.472788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 41/87] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:05.479053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46f0c-fe36-4566-bf51-6b1917ffc1df None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.479903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46f0c-fe36-4566-bf51-6b1917ffc1df None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.480370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46f0c-fe36-4566-bf51-6b1917ffc1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.499597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:05.505302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-93b46f0c-fe36-4566-bf51-6b1917ffc1df None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:05.506691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-93b46f0c-fe36-4566-bf51-6b1917ffc1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:05.529285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59511-1ea2-4866-91d8-fab83a000b6d None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.529580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59511-1ea2-4866-91d8-fab83a000b6d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.529860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59511-1ea2-4866-91d8-fab83a000b6d None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.531197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 42/88] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:05.536287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fae74d-d6bb-4d42-bc45-ca278838e1a2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.536853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fae74d-d6bb-4d42-bc45-ca278838e1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.537322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fae74d-d6bb-4d42-bc45-ca278838e1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.557316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b7fae74d-d6bb-4d42-bc45-ca278838e1a2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:05.558884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b7fae74d-d6bb-4d42-bc45-ca278838e1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:05.635123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 47/89] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:05.636756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11913-636c-4856-8d60-9b65c1d4ef3f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.637232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11913-636c-4856-8d60-9b65c1d4ef3f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.637693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11913-636c-4856-8d60-9b65c1d4ef3f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.640831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 48/90] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:05.646379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f2d5-1161-4109-9497-8189be8ee1dd None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.646958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f2d5-1161-4109-9497-8189be8ee1dd None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.647462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f2d5-1161-4109-9497-8189be8ee1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.683977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5062f2d5-1161-4109-9497-8189be8ee1dd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:05.686993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5062f2d5-1161-4109-9497-8189be8ee1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:05.691244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 43/91] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:05.783164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 49/92] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:05.850634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9a10-8ad6-4fb9-a7b1-0bddc42b6f3c None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.851231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9a10-8ad6-4fb9-a7b1-0bddc42b6f3c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.851693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9a10-8ad6-4fb9-a7b1-0bddc42b6f3c None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.853289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 44/93] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:05.858749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:05.859268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:05.859747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:05.886740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:05.888509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:05.961812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:05.975080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 50/94] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:06.083217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9a10-8ad6-4fb9-a7b1-0bddc42b6f3c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.132283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.150945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.239031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9a10-8ad6-4fb9-a7b1-0bddc42b6f3c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.242209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffbff2-3698-4a33-afc3-87376893776e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.288354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.289691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.291722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.292235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.310771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.311731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.312210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.312677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.326685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:06.331550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:06.332388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:06.333161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 51/95] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:06.341080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:06.346332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:06.347186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:06.347938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:06.354826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 45/96] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:06.358835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.358982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.425761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.465696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4398670-0857-4d99-9faf-17b1e2900230 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.474516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311c7c-d904-4de5-a5c1-35f21d51c338 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.477481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.505048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.505916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.506339 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.506758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.507565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:06.508033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:06.509856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.510466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.510746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.510910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:06.511026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.511668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:06.511968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:06.513601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:06.520890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 46/97] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:06.527169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 52/98] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:06.527169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.527355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.630158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448510a-38e0-49bd-8c51-f84e7adbc7f1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.637033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe3b3-2393-4c11-9992-e4b2f9706a96 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.655318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.665784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.666502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.666793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.675984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225d0e-7a88-49b4-8bba-6f41b5ed147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.676787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225d0e-7a88-49b4-8bba-6f41b5ed147c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.677062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225d0e-7a88-49b4-8bba-6f41b5ed147c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.677332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225d0e-7a88-49b4-8bba-6f41b5ed147c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.677429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:06.678509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb225d0e-7a88-49b4-8bba-6f41b5ed147c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:06.679967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb225d0e-7a88-49b4-8bba-6f41b5ed147c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:06.692707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 53/99] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:06.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:06.693668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:06.694467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:06.695042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71534-5a7a-43d1-81ed-1c002aad92c3 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.695042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71534-5a7a-43d1-81ed-1c002aad92c3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.695042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71534-5a7a-43d1-81ed-1c002aad92c3 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.695214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 47/100] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:06.695293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 54/101] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:06.695359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.695430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71534-5a7a-43d1-81ed-1c002aad92c3 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.725246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.799064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71534-5a7a-43d1-81ed-1c002aad92c3 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.804468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5d28-1278-4207-b92f-ac68025d8bad None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.836964 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.837607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.837932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.838201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] PATH_INFO: `/v3/users/ce00856f249a4350b173240c06edfe65` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.839311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ce00856f249a4350b173240c06edfe65)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:06.840914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:06.841862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.842685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.842785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 55/102] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/users/ce00856f249a4350b173240c06edfe65 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:06.843303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.846090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.846377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] PATH_INFO: `/v3/users/8d5d98041c1648359c430a99cb06e7e3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.861647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] RBAC: Authorizing `identity:get_user(user_id=8d5d98041c1648359c430a99cb06e7e3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:06.863785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:06.865466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 48/103] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/users/8d5d98041c1648359c430a99cb06e7e3 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:06.870862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:06.903580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.945763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375a63f-ac79-4d60-8a59-2bada1cde8b1 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.959728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:06.971931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093fd8f-8114-4f4d-9f33-89cf15440728 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:06.984025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:06.984640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.984919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.985194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:06.985891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:06.986200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:06.987585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164184c-a794-4441-9f2c-85c34d293703 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:06.996154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 56/104] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:06.997388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:06.997759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:06.998052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.009436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.010079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.010363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.011038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.011689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:07.013379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:07.015832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:07.017022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:07.038471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 49/105] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:49:06 2022] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:07.039296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.097783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 57/106] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:07.098559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.164338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:07.188482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518635-97c3-4ede-bbd6-4f449d794c38 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.233867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.234845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.235259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.235431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.239559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b56389-694b-473e-b0d0-e16e5356e4b8 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.248608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:07.293202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3811cf-bf04-4407-b69b-e6e432060d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.294288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3811cf-bf04-4407-b69b-e6e432060d33 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.294789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3811cf-bf04-4407-b69b-e6e432060d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.295272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3811cf-bf04-4407-b69b-e6e432060d33 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.296435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3811cf-bf04-4407-b69b-e6e432060d33 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:07.297978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3811cf-bf04-4407-b69b-e6e432060d33 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:07.300117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 58/107] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:07.301406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe08ee7-9907-4e4b-9934-374ff12d3fdf None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.301696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe08ee7-9907-4e4b-9934-374ff12d3fdf None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.302047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe08ee7-9907-4e4b-9934-374ff12d3fdf None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.303378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 59/108] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:07.304027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe08ee7-9907-4e4b-9934-374ff12d3fdf None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.318118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:07.319593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:07.412874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe08ee7-9907-4e4b-9934-374ff12d3fdf None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.430487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:07.442721 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 50/109] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:07.442721 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.458972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210027f-930d-4961-bf23-77160b5ea7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.459765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210027f-930d-4961-bf23-77160b5ea7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.460052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210027f-930d-4961-bf23-77160b5ea7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.460325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210027f-930d-4961-bf23-77160b5ea7f2 None admin] PATH_INFO: `/v3/users/ce00856f249a4350b173240c06edfe65` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.461450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210027f-930d-4961-bf23-77160b5ea7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ce00856f249a4350b173240c06edfe65)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:07.463193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210027f-930d-4961-bf23-77160b5ea7f2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:07.465182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 60/110] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/users/ce00856f249a4350b173240c06edfe65 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:07.466627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.466925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.467201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.486446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:07.487639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:07.489371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:07.556737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15f79f-a9d9-4f57-806c-4920b72d0a65 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.565987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 61/111] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:07.565987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.593526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.594844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.595138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.595414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619/users/8d5d98041c1648359c430a99cb06e7e3/roles/e179fa62b70f46c2aa5a556c0312b9e5` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.598263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=921d232f84fb4aba890912996255f619, user_id=8d5d98041c1648359c430a99cb06e7e3, role_id=e179fa62b70f46c2aa5a556c0312b9e5)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:07.600000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:07.618021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 51/112] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:07 2022] PUT /identity/v3/projects/921d232f84fb4aba890912996255f619/users/8d5d98041c1648359c430a99cb06e7e3/roles/e179fa62b70f46c2aa5a556c0312b9e5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:07.619191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.676321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb708f3-7571-4589-9721-344e6c0af612 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.691015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:07.714493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.715294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.715677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.716098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.733143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:07.740547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:07.741649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:07.742488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:07.746627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 62/113] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:07.746627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.765233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db208b6-ad6f-47cc-a8c9-12dfcdaf1bb0 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.768947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:07.843990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.844695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.844982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.845262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.846751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:07.848232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:07.856290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 52/114] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:07.857155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:07.916195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138612-18a7-4eb3-8e96-14aebd6d731c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:07.959092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:07.959637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:07.959921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:07.960247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:07.976283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6a94-cb26-4eed-b17e-8f3255f7e238 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.018297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.022782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.023745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.025654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.026177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.027681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:08.028407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.030451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.042692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 53/115] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:08.043978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.050152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.051821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.091936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.164183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 63/116] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:08.165860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.182270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55648e-0493-40d8-99d1-314fbbc12fd2 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.220768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.221305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.221645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.221969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.222809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] RBAC: Adding query filter params (role.id=b73e3a3a46cf4bfaaffedeae6ece231e, scope.project.id=921d232f84fb4aba890912996255f619, user.id=ce00856f249a4350b173240c06edfe65) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:08.223126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.224596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.232546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 54/117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/role_assignments?user.id=ce00856f249a4350b173240c06edfe65&scope.project.id=921d232f84fb4aba890912996255f619&role.id=b73e3a3a46cf4bfaaffedeae6ece231e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:08.238851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.279349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.338376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efe16b-5481-40c8-b29b-8d9d594e258b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.391933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.392588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.392871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.393148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.410000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:08.418235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:08.419109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:08.419849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 64/118] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:08.420463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.467181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.476454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51bfa-65ce-4ba6-8874-7927ac086c11 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.518659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.519893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.520186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.520835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] PATH_INFO: `/v3/users/b0376d5185ac4115b7c02b4f3223cf16` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.522686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] RBAC: Authorizing `identity:get_user(user_id=b0376d5185ac4115b7c02b4f3223cf16)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.525038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.528194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 55/119] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/users/b0376d5185ac4115b7c02b4f3223cf16 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:08.529767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.533361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26270b8-2063-46e1-b9af-4efaad94e8a5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.571499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.580281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.580946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.581224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.581496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.583807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.585032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.587528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 65/120] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:08.588312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.676554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c687d-f502-4972-8b99-13aa3a61db55 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.714462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed543-bf23-4e53-9f04-7dae637db536 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.719042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.719659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.719944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.720224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.720898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:08.721237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.723096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.733827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 56/121] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:08.734565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:08.755699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.756446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.756889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.757165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.771649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.845510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:08.848272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.849919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.863157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925a9b-e98b-40b7-bf3b-5c3c5be1ac50 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:08.898320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:08.898930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:08.899207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:08.899511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:08.900232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] RBAC: Adding query filter params (role.id=ba67557ce74c431c93432833ee06b87f, scope.project.id=921d232f84fb4aba890912996255f619, user.id=ce00856f249a4350b173240c06edfe65) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:08.900537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:08.902053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:08.908380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 57/122] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/role_assignments?user.id=ce00856f249a4350b173240c06edfe65&scope.project.id=921d232f84fb4aba890912996255f619&role.id=ba67557ce74c431c93432833ee06b87f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:08.909190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:09.020675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625c492-6176-496f-9d69-4eac5467bbfe None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:09.022545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:09.032379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 66/123] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:09.038139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:09.066612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:09.067506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.067817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.068309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] PATH_INFO: `/v3/users/ce00856f249a4350b173240c06edfe65` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.070472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=ce00856f249a4350b173240c06edfe65)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:09.072479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:09.074347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 58/124] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:08 2022] GET /identity/v3/users/ce00856f249a4350b173240c06edfe65 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:09.087583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:09.169617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:09.173265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a5d1c-800b-4336-a2ae-762e51d84ad9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:09.219779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:09.220810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.221335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.221911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.225266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:09.227115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:09.229125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 67/125] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:09 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:09.234864 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:09.249564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9583-0588-4d0b-8355-eb1d4ca5d6c1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:09.288453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862daf-4828-4329-beb5-8008425ddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:09.288981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862daf-4828-4329-beb5-8008425ddfaa None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.289263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862daf-4828-4329-beb5-8008425ddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.289539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862daf-4828-4329-beb5-8008425ddfaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.323132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:09.361238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad333ae-b05e-4834-916c-eaa56cdd803d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:09.371153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc862daf-4828-4329-beb5-8008425ddfaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:09.373619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc862daf-4828-4329-beb5-8008425ddfaa None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:09.402028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:09.403084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.403363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.403637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.404512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=921d232f84fb4aba890912996255f619, user.id=b0376d5185ac4115b7c02b4f3223cf16) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:09.404952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:09.406667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:09.414750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 68/126] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:09 2022] GET /identity/v3/role_assignments?user.id=b0376d5185ac4115b7c02b4f3223cf16&scope.project.id=921d232f84fb4aba890912996255f619&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:09.505830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 59/127] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:09.512050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:09.543881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0058556-9044-4238-88c3-bddebb3671db None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.544356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0058556-9044-4238-88c3-bddebb3671db None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.544356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0058556-9044-4238-88c3-bddebb3671db None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.545964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 60/128] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:09.552382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.552690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.552929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.559678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:09.580722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:09.581987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:09.648922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131029b-fceb-465b-b2fa-3345d69c70f9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:09.652975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:09.676024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 61/129] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:09.694783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:09.695416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.695692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.695962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] PATH_INFO: `/v3/projects/efa13a41d8af49618db1d3ea628bb73a` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.697932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] RBAC: Authorizing `identity:get_project(project_id=efa13a41d8af49618db1d3ea628bb73a)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:09.699375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:09.701155 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 69/130] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:09 2022] GET /identity/v3/projects/efa13a41d8af49618db1d3ea628bb73a => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:09.706925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:09.807801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba49f16-9cad-4596-9602-f0aac7c8c36f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:09.840207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:09.840814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:09.841092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:09.841364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:09.842119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] RBAC: Adding query filter params (role.id=ba67557ce74c431c93432833ee06b87f, scope.project.id=efa13a41d8af49618db1d3ea628bb73a, user.id=ce00856f249a4350b173240c06edfe65) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:09.842425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:09.844343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfb6d-8960-49d9-89eb-034eefdd4fad None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:09.850294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 62/131] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:09 2022] GET /identity/v3/role_assignments?user.id=ce00856f249a4350b173240c06edfe65&scope.project.id=efa13a41d8af49618db1d3ea628bb73a&role.id=ba67557ce74c431c93432833ee06b87f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:09.951267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:10.041377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fdd8-7475-43fd-be54-5dd7c8384a33 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.041658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fdd8-7475-43fd-be54-5dd7c8384a33 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.042028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fdd8-7475-43fd-be54-5dd7c8384a33 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.043398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 63/132] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:10.048473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.048755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.049023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.069050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:10.070089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:10.071416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:10.073440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e651a-41f1-4f0a-8c99-28852da2658d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:10.111235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:10.111867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.112151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.112427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.113546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:10.115031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:10.116597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 70/133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:10.122029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:10.123120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:10.143178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 64/134] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:10.217060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf537a8-4659-405d-b138-df9b8708b24f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:10.248732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:10.249337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.249619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.249935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.250594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:10.252036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:10.279154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 71/135] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:10 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 05:49:10.414011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:10.515131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180d53-3672-4443-8d9b-39e02e5a5e52 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:10.549765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:10.550400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.550682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.550953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.562077 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:10.566914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:10.567769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:10.568532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:10.569323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 65/136] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:10.575585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:10.601655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:10.690617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a411ba-bd0d-49c4-8e39-d28b9358b3f8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:10.729241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:10.729904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.730195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.730521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.731205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:10.731605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:10.733021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:10.741957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 72/137] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:10.748426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:10.795013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:10.861424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce3263-28df-469f-ab20-5bc8761debc9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:10.896938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:10.897572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:10.897878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:10.898156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] PATH_INFO: `/v3/users/8d5d98041c1648359c430a99cb06e7e3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:10.899296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] RBAC: Authorizing `identity:get_user(user_id=8d5d98041c1648359c430a99cb06e7e3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:10.901268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:10.903228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 66/138] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:10 2022] GET /identity/v3/users/8d5d98041c1648359c430a99cb06e7e3 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:10.908619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:11.000453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:11.017391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17893a40-f2d1-42ab-8c28-e3f28d3c73eb None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:11.051700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:11.052594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:11.053043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:11.053461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:11.131694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:11.133175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:11.226112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:11.233673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:11.239941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:11.352412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31ab8-bea3-438f-8924-90c0f44300bf None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:11.363914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:11.388729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08171695-2437-42cc-bf53-018fe7bc4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:11.389361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08171695-2437-42cc-bf53-018fe7bc4ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:11.389640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08171695-2437-42cc-bf53-018fe7bc4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:11.389938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08171695-2437-42cc-bf53-018fe7bc4ba5 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:11.391069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08171695-2437-42cc-bf53-018fe7bc4ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:11.392526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08171695-2437-42cc-bf53-018fe7bc4ba5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:11.394179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 67/140] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:11 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:11.400339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:11.505183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78f1e-8297-4c47-9f7d-67c61d130adf None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:11.542556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884f144-8416-4020-8599-479454ca020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:11.543220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884f144-8416-4020-8599-479454ca020b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:11.543514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884f144-8416-4020-8599-479454ca020b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:11.543784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884f144-8416-4020-8599-479454ca020b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:11.544502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884f144-8416-4020-8599-479454ca020b None admin] RBAC: Adding query filter params (role.id=e179fa62b70f46c2aa5a556c0312b9e5, scope.project.id=921d232f84fb4aba890912996255f619, user.id=8d5d98041c1648359c430a99cb06e7e3) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:11.544807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884f144-8416-4020-8599-479454ca020b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:11.546267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884f144-8416-4020-8599-479454ca020b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:11.552212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 74/141] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:11 2022] GET /identity/v3/role_assignments?user.id=8d5d98041c1648359c430a99cb06e7e3&scope.project.id=921d232f84fb4aba890912996255f619&role.id=e179fa62b70f46c2aa5a556c0312b9e5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:12.572249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40136f-53a5-4064-a327-cbf7d1b1d291 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:12.572785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40136f-53a5-4064-a327-cbf7d1b1d291 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:12.572785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40136f-53a5-4064-a327-cbf7d1b1d291 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:12.574186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 68/142] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:12.579188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d255c-6faa-4904-a546-b3a772cf055f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:12.579959 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d255c-6faa-4904-a546-b3a772cf055f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:12.580234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d255c-6faa-4904-a546-b3a772cf055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:12.598640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-975d255c-6faa-4904-a546-b3a772cf055f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:12.599812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-975d255c-6faa-4904-a546-b3a772cf055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:12.655875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:12.680222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 75/143] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:12.762901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2da3-cc9e-49fa-916a-d45ccd86db89 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:12.763190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2da3-cc9e-49fa-916a-d45ccd86db89 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:12.763908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2da3-cc9e-49fa-916a-d45ccd86db89 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:12.765258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 69/144] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:12.770692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:12.770981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:12.771261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:12.789383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:12.791092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:12.795879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e22b7-49e1-438d-b359-9d2f3436c27b None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:12.796165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e22b7-49e1-438d-b359-9d2f3436c27b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:12.796441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e22b7-49e1-438d-b359-9d2f3436c27b None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:12.797929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 70/145] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:12.802765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:12.803050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:12.803333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:12.822345 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:12.823537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:12.864601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 76/146] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:12.893329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 71/147] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:12.948047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.056271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118acc-b7c0-4c46-981a-d709e1224c1c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.067259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.091391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.092024 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.095879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.096178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.106985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:13.111778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:13.112653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:13.113447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 77/148] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:49:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:13.121030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.133660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.221129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37dc8e-3696-41c9-af8f-5ca2fe72faa1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.230258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.235338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8715a3-4568-400e-b154-2aefbf49c5b0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.255860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.256465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.256745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.257014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.257675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:13.258006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.259930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.268189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 72/149] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:13.270681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.271258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.271893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.272176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.272448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.282885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:13.287722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:13.288614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 78/150] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:13.289616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.318709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.372477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757cc45-5c6f-41bc-a416-cdcc88597a92 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.389801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f927-9012-4e8a-8121-09c63cd32df8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.404505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.405128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.405417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.405690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.406820 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.408265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.409851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:13.410622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.422744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.423366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.423639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.423908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] PATH_INFO: `/v3/users/b185c13f72b14bbb8561d4161a18154d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.438958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] RBAC: Authorizing `identity:get_user(user_id=b185c13f72b14bbb8561d4161a18154d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.440412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.442020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/users/b185c13f72b14bbb8561d4161a18154d => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:13.442764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.452136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.511220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455bfd-2586-48da-9ad1-37a1964f8474 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.526633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.538565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c800e-68a6-45b2-a72c-06d2c7eef909 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.544816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.545414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.545692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.545992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.546652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:13.546949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.548308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.556190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 74/153] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:13.556190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.573268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.573915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.574196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.574476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.575128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.576602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.596553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 80/154] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:13 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:13.597974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.671389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.675439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dde839-d120-43fe-b75f-6f140ffbdb30 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.714669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.715318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.715596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.715866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.717230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.718627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.720191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf699cc-8532-4327-ab99-d8ed947b230c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.720298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 75/155] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:13.726087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.760429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.761389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.761872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.762151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] PATH_INFO: `/v3/users/b185c13f72b14bbb8561d4161a18154d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.763593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] RBAC: Authorizing `identity:get_user(user_id=b185c13f72b14bbb8561d4161a18154d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.765597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.767388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 81/156] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/users/b185c13f72b14bbb8561d4161a18154d => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:13.772639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:13.790923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:13.859358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b10d-cd04-43e0-a794-3dcbccfd48c8 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.899046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.900341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.900678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.901122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/b185c13f72b14bbb8561d4161a18154d/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.903298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] RBAC: Authorizing `identity:create_grant(project_id=46c60afb47644b7eb2c06c075a2525f9, user_id=b185c13f72b14bbb8561d4161a18154d, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.905718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.915102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13f13-d5f0-4d8a-8ee1-6891dca8b920 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:13.923411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 76/157] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:13 2022] PUT /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/b185c13f72b14bbb8561d4161a18154d/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:49:13.961639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066afbda-85af-4b90-b233-53c3bac76a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:13.963025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afbda-85af-4b90-b233-53c3bac76a13 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:13.963310 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afbda-85af-4b90-b233-53c3bac76a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:13.963623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afbda-85af-4b90-b233-53c3bac76a13 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:13.964894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066afbda-85af-4b90-b233-53c3bac76a13 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:13.966578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066afbda-85af-4b90-b233-53c3bac76a13 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:13.968511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 82/158] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:13 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:13.975027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:14.011194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:14.098428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151ffe-c5f8-4603-8179-1a9f771d18ae None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:14.135576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e663-64f0-46dc-bcc1-caa4de0202ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:14.136495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e663-64f0-46dc-bcc1-caa4de0202ae None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:14.136911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e663-64f0-46dc-bcc1-caa4de0202ae None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:14.137327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e663-64f0-46dc-bcc1-caa4de0202ae None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/b185c13f72b14bbb8561d4161a18154d/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:14.139938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e663-64f0-46dc-bcc1-caa4de0202ae None admin] RBAC: Authorizing `identity:create_grant(project_id=46c60afb47644b7eb2c06c075a2525f9, user_id=b185c13f72b14bbb8561d4161a18154d, role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:14.141546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e663-64f0-46dc-bcc1-caa4de0202ae None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:14.157102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 77/159] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:13 2022] PUT /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/b185c13f72b14bbb8561d4161a18154d/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:16.030556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138326fd-5386-421d-bfa2-e2f7535db70c None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.031072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138326fd-5386-421d-bfa2-e2f7535db70c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.031307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138326fd-5386-421d-bfa2-e2f7535db70c None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.032751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 83/160] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:16.038097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46153-70be-4077-9782-e9cbc35bc965 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.038505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46153-70be-4077-9782-e9cbc35bc965 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.038855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46153-70be-4077-9782-e9cbc35bc965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.057793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e2d46153-70be-4077-9782-e9cbc35bc965 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:16.058991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e2d46153-70be-4077-9782-e9cbc35bc965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:16.094826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178380fa-143d-428d-9fac-9655fd863ab9 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.095137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178380fa-143d-428d-9fac-9655fd863ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.096446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178380fa-143d-428d-9fac-9655fd863ab9 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.097416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 84/161] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:16.102101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509622e5-7201-4ee1-91b4-873125d3bfce None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.102387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509622e5-7201-4ee1-91b4-873125d3bfce None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.102771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509622e5-7201-4ee1-91b4-873125d3bfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.121958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-509622e5-7201-4ee1-91b4-873125d3bfce None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:16.122968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-509622e5-7201-4ee1-91b4-873125d3bfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:16.133206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 78/162] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:16.202310 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 85/163] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:16.255458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af118-f54b-48e3-9697-c6171c846d2a None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.255633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af118-f54b-48e3-9697-c6171c846d2a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.255915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af118-f54b-48e3-9697-c6171c846d2a None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.257400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 79/164] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:16.263183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.263716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.263991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.283035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:16.284205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:16.287023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:16.354878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 86/165] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:16.432680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af118-f54b-48e3-9697-c6171c846d2a None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:16.455550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:16.499778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:16.546392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af118-f54b-48e3-9697-c6171c846d2a None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:16.582091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb90b-6247-43b1-9193-49586efd4c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:16.582963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb90b-6247-43b1-9193-49586efd4c2a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.583321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb90b-6247-43b1-9193-49586efd4c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.583625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb90b-6247-43b1-9193-49586efd4c2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.594629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb90b-6247-43b1-9193-49586efd4c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-4d5cb90b-6247-43b1-9193-49586efd4c2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:16.599418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:16.600460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:16.601448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 80/166] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:16.602357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908cfef-a2c3-43a1-a71f-05f28db76ab4 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.602357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908cfef-a2c3-43a1-a71f-05f28db76ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.602911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908cfef-a2c3-43a1-a71f-05f28db76ab4 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.603988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 81/167] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:16.609158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.609436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.609924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.612721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758eb96-13b5-4f32-90f9-9b78798f045b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:16.630438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:16.631810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:16.650639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:16.651278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.651557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.651826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.652928 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:16.654405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:16.656091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 87/168] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:16.656860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:16.668107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:16.700322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 82/169] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:16.701170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:16.710689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:16.760390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76868de-1fc6-45c0-acf2-54b1931cf5b3 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:16.796636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:16.797334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.797957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.798236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.799033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:16.799340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:16.800730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:16.808992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c1107-cd1d-4ff9-8bd5-cc56040e7a38 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:16.815114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 88/170] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:16.815114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:16.845016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:16.845638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.845943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.846212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.856949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:16.861780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:16.862691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:16.863485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 83/171] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:16.864135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:16.899064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:16.934338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc98f1d-933c-4b1e-9ceb-83d6a447c460 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:16.935404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:16.971325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:16.971990 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:16.972271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:16.972541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:16.973194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:16.974120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ff91-3798-4537-a377-bfa82f49ae7a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:16.974669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:16.996027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 89/172] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:16 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:16.997079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.022821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.023591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.023867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.024131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] PATH_INFO: `/v3/users/ab318e5d03f6440d83858cf2d01e42fa` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.041621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] RBAC: Authorizing `identity:get_user(user_id=ab318e5d03f6440d83858cf2d01e42fa)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.043258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.045581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 84/173] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:16 2022] GET /identity/v3/users/ab318e5d03f6440d83858cf2d01e42fa => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:17.046248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.117024 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca00e2c-dd37-4411-9c1d-2d8250b5ad10 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.146108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:17.159520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6b0cf-c628-4b5c-bd9d-1e5e243c5e5c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.159725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.160236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.160520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.160793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.161474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:17.161799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.163227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.175179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:17.176044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.193238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:17.205408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.206189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.206368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.206638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.219982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:17.224900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:17.225824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:17.226597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 85/175] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:17.227251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.296178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d78952-a280-43ce-a37a-4a2c98f8128f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.337798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.338727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.339200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.339638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.340726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920c6f8-c852-4600-b36e-67ebd52a3205 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.341545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.343423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.345265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 91/176] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:17.346256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.379276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.379834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.380110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.380381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] PATH_INFO: `/v3/users/b185c13f72b14bbb8561d4161a18154d` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.381909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] RBAC: Authorizing `identity:get_user(user_id=b185c13f72b14bbb8561d4161a18154d)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.383381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.385794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 86/177] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/users/b185c13f72b14bbb8561d4161a18154d => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:17.389993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.419957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:17.461277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:17.481198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91628-7184-4093-9afd-9c6a16a7c9a7 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.520611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699616e-5259-42fe-bd52-c441bbae7302 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.521801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.522576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.523627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.523916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.524629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:17.525011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.526427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.538574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 92/178] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:17.539460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.568000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.568953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.569235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.569956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/ab318e5d03f6440d83858cf2d01e42fa/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.573324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] RBAC: Authorizing `identity:create_grant(project_id=46c60afb47644b7eb2c06c075a2525f9, user_id=ab318e5d03f6440d83858cf2d01e42fa, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.576113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.592959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 87/179] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:17 2022] PUT /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/ab318e5d03f6440d83858cf2d01e42fa/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:17.594245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.676097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d755e-38a1-4488-91fb-9e426e51dbd3 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.701603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:17.729181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.730465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.731387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.732142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.736833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2732-7812-44cc-89a7-8e103583b762 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.754871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:17.781672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.782121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.782441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.782716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] PATH_INFO: `/v3/users/b185c13f72b14bbb8561d4161a18154d` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.783844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] RBAC: Authorizing `identity:get_user(user_id=b185c13f72b14bbb8561d4161a18154d)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.785408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.787880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 88/180] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/users/b185c13f72b14bbb8561d4161a18154d => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:17.794109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:17.834878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:17.836753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:17.907984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949e50d-a105-49d2-acd2-ff7524f5b82b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:17.948301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:17.949762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:17.950268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:17.951154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:17.980209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 93/181] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:17.985877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:18.008002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:18.023861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:18.051991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:18.054849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:18.118205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d746b-6106-407d-a68e-1a20409d49ab None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:18.167209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:18.167434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 89/182] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 05:49:18.168302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:18.168779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:18.169276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:18.170659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:18.172478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:18.172917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:18.174571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 94/183] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:17 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:18.182558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:18.282003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:18.301467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c72151-e41c-4146-9140-3172cadf4d8f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:18.342907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:18.343904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:18.344384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:18.344869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:18.345825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=46c60afb47644b7eb2c06c075a2525f9, user.id=b185c13f72b14bbb8561d4161a18154d) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:18.346333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:18.348574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:18.356056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 95/184] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:18 2022] GET /identity/v3/role_assignments?user.id=b185c13f72b14bbb8561d4161a18154d&scope.project.id=46c60afb47644b7eb2c06c075a2525f9&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:18.370112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:18.394897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855104-2d24-4eb9-8c8e-51d84b5da5e8 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:18.434065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab8695-7311-497e-bd2c-3672c95bee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:18.435075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab8695-7311-497e-bd2c-3672c95bee1a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:18.435556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab8695-7311-497e-bd2c-3672c95bee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:18.436059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab8695-7311-497e-bd2c-3672c95bee1a None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:18.437429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab8695-7311-497e-bd2c-3672c95bee1a None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:18.439147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab8695-7311-497e-bd2c-3672c95bee1a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:18.441082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 90/185] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:18 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:18.450876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:18.583740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38bf2-6ef3-4583-800a-5dab21509c53 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:18.621880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:18.622902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:18.623385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:18.623856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:18.624841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] RBAC: Adding query filter params (role.id=b73e3a3a46cf4bfaaffedeae6ece231e, scope.project.id=46c60afb47644b7eb2c06c075a2525f9, user.id=b185c13f72b14bbb8561d4161a18154d) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:18.625373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:18.627184 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe540-3480-4eb3-8e6c-49d615f9ab5d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:18.635007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 96/186] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:18 2022] GET /identity/v3/role_assignments?user.id=b185c13f72b14bbb8561d4161a18154d&scope.project.id=46c60afb47644b7eb2c06c075a2525f9&role.id=b73e3a3a46cf4bfaaffedeae6ece231e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:19.418882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d34b-5e8d-4a66-8b61-7bc012bc22db None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:19.419427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d34b-5e8d-4a66-8b61-7bc012bc22db None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:19.419427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d34b-5e8d-4a66-8b61-7bc012bc22db None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:19.420888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 91/187] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:19.425857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ae14b-2ff3-4de5-bec9-53852ba3c4f5 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:19.426247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ae14b-2ff3-4de5-bec9-53852ba3c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:19.426407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ae14b-2ff3-4de5-bec9-53852ba3c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:19.444909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-399ae14b-2ff3-4de5-bec9-53852ba3c4f5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:19.446112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-399ae14b-2ff3-4de5-bec9-53852ba3c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:19.456639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:19.517299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 97/188] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:19.661114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497c22-cbd5-4d4b-a8c6-1f483cf69afb None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:19.661470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497c22-cbd5-4d4b-a8c6-1f483cf69afb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:19.661668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497c22-cbd5-4d4b-a8c6-1f483cf69afb None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:19.663178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 92/189] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:19.668715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:19.669056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:19.669279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:19.687301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:19.688467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:19.753296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 98/190] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:19.789806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497c22-cbd5-4d4b-a8c6-1f483cf69afb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:19.895475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497c22-cbd5-4d4b-a8c6-1f483cf69afb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:19.931767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:19.932367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:19.932646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:19.932916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:19.943050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:19.948357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:19.949224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:19.950060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 93/191] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:19.956591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.019987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.033467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:20.037132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:20.065691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7e97d-ee17-4e18-ba0f-60c8eb54c74e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.102381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.103332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.103682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.103962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.104629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:20.104933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:20.106330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:20.114864 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 99/192] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:20.120462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.129416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18db58-420e-4d59-8133-459dfbb0971d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.170743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.171398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.171676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.171951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.173140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:20.174699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:20.176408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 94/193] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:20.182882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.233991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c02c-767c-43c7-ac37-cf3bbb0e9eb3 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.269129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddadf2-f253-40f1-abd1-8d14a0b82c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.269781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddadf2-f253-40f1-abd1-8d14a0b82c6b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.270062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddadf2-f253-40f1-abd1-8d14a0b82c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.270333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddadf2-f253-40f1-abd1-8d14a0b82c6b None admin] PATH_INFO: `/v3/users/9a9658a4e4a2431e92bc465fb4588cad` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.271800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:20.273205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:20.284178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddadf2-f253-40f1-abd1-8d14a0b82c6b None admin] RBAC: Authorizing `identity:get_user(user_id=9a9658a4e4a2431e92bc465fb4588cad)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:20.285629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddadf2-f253-40f1-abd1-8d14a0b82c6b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:20.287283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 100/194] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:20 2022] GET /identity/v3/users/9a9658a4e4a2431e92bc465fb4588cad => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:20.288440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d56ed4-6875-4860-9237-4660321eacfd None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.288718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d56ed4-6875-4860-9237-4660321eacfd None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.288987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d56ed4-6875-4860-9237-4660321eacfd None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.290862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 101/195] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:20.293262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d56ed4-6875-4860-9237-4660321eacfd None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.297725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6f38-c983-4980-8179-897a640ffbce None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.331535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc81eaf-81f0-4255-8beb-adfe2111c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.332141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc81eaf-81f0-4255-8beb-adfe2111c008 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.332421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc81eaf-81f0-4255-8beb-adfe2111c008 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.332695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc81eaf-81f0-4255-8beb-adfe2111c008 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.333354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc81eaf-81f0-4255-8beb-adfe2111c008 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:20.334835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc81eaf-81f0-4255-8beb-adfe2111c008 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:20.356146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 95/196] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:20 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 05:49:20.357547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.357861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.358131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.378184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:20.379403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:20.414292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d56ed4-6875-4860-9237-4660321eacfd None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.452026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 96/197] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:20.453472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.454220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.454480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.454816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.455997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:20.457458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:20.459293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 102/198] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:20 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:20.465543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.531513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:20.576284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187fd95-69a8-4f5c-814b-561aee6390d0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.613684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.614387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.614659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.614955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/9a9658a4e4a2431e92bc465fb4588cad/roles/e179fa62b70f46c2aa5a556c0312b9e5` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.616887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=46c60afb47644b7eb2c06c075a2525f9, user_id=9a9658a4e4a2431e92bc465fb4588cad, role_id=e179fa62b70f46c2aa5a556c0312b9e5)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:20.618377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:20.635012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 97/199] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:20 2022] PUT /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9/users/9a9658a4e4a2431e92bc465fb4588cad/roles/e179fa62b70f46c2aa5a556c0312b9e5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:20.736296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:20.808667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:20.853268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705cd5a-a483-41e4-94e8-0fa947cdbff6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:20.889550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:20.890574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:20.891052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:20.891547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:20.903176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:20.909078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:20.909992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:20.910784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:20.913315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:20.919395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:21.039873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af895b-9e6c-4697-9080-c6bfc61b00c5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:21.065210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:21.077757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:21.081899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:21.082414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:21.082883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:21.083754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] RBAC: Adding query filter params (name=member) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:21.084250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:21.085880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:21.095949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 98/201] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:21.105809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:21.206619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef56f5-6882-46c4-b789-233e32c7aeda None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:21.230735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:21.243942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:21.244555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:21.244763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:21.245034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] PATH_INFO: `/v3/users/ab318e5d03f6440d83858cf2d01e42fa` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:21.246229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=ab318e5d03f6440d83858cf2d01e42fa)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:21.247701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:21.249301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 104/202] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:21 2022] GET /identity/v3/users/ab318e5d03f6440d83858cf2d01e42fa => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:21.254929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:21.361344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d06b-d6da-42fb-a26e-4cf8d4fb25be None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:21.396983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:21.397595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:21.397910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:21.398182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:21.459419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:21.474135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:21.475642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:21.580369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 99/203] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:21.585942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:21.688891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec83b5-6968-42e8-9756-0bcf9e6ba0a8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:21.722637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a978-5b6f-4f2b-82a3-df8721371af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:21.723556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a978-5b6f-4f2b-82a3-df8721371af4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:21.724001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a978-5b6f-4f2b-82a3-df8721371af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:21.724459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a978-5b6f-4f2b-82a3-df8721371af4 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:21.725732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a978-5b6f-4f2b-82a3-df8721371af4 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:21.727459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a978-5b6f-4f2b-82a3-df8721371af4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:21.733835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:21 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:21.735716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:21.822881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:21.839296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59b43d-aa47-4f44-97d5-7be1cb5261b1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:21.874949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:21.875870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:21.876315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:21.876763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:21.877653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] RBAC: Adding query filter params (role.id=ba67557ce74c431c93432833ee06b87f, scope.project.id=46c60afb47644b7eb2c06c075a2525f9, user.id=ab318e5d03f6440d83858cf2d01e42fa) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:21.878158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:21.879798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c360-57b6-44d9-9972-58771ddb0538 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:21.887059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 100/205] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:21 2022] GET /identity/v3/role_assignments?user.id=ab318e5d03f6440d83858cf2d01e42fa&scope.project.id=46c60afb47644b7eb2c06c075a2525f9&role.id=ba67557ce74c431c93432833ee06b87f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:22.785273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69eca1-cc2d-4665-8583-ff55d6101b49 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:22.785819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69eca1-cc2d-4665-8583-ff55d6101b49 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:22.785898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69eca1-cc2d-4665-8583-ff55d6101b49 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:22.787341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 106/206] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:22.792517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414df9f-c6fb-4580-ac2f-4e748345fd57 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:22.792905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414df9f-c6fb-4580-ac2f-4e748345fd57 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:22.793057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414df9f-c6fb-4580-ac2f-4e748345fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:22.797926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed692d-2556-4050-86b0-27a38e8c7741 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:22.798139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed692d-2556-4050-86b0-27a38e8c7741 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:22.798412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed692d-2556-4050-86b0-27a38e8c7741 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:22.799798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 107/207] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:22.805342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:22.806121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:22.806530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:22.813412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e414df9f-c6fb-4580-ac2f-4e748345fd57 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:22.814628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e414df9f-c6fb-4580-ac2f-4e748345fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:22.826263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:22.827578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:22.882272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:22.885789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 101/208] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:22.886232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422859-ad15-4c56-82cc-389be29e1a8d None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:22.886605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422859-ad15-4c56-82cc-389be29e1a8d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:22.886884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422859-ad15-4c56-82cc-389be29e1a8d None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:22.888129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:22.893456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:22.893727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:22.894020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:22.901882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:22.911460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:22.912623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:22.985094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 103/211] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:23.157408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.167603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.179982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:23.259648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d382-5779-47e8-9cdf-8298deba2e47 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.273527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121192f-e34d-42a5-a218-96a1613ffc84 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.293044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.293672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.293981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.294256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.305064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:23.308336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.308967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.309244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.309516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:23.310545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:23.311459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:23.312294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:23.313435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.313504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 109/212] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:23.313567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.313639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.313705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 104/213] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:23.317690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.361108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:23.394817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:23.410833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd1c1-f13f-48da-8719-15f5aec676dd None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.416302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cada63-a58f-447f-a7d9-e2b8cf8e88b9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.444863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.445479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.445765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.446039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.450003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.450597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.450875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.451138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.451789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:23.452080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.453438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.455943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:23.460707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:23.461583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:23.463235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:23.463836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 105/214] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:23.463904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:23.463982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.468229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.560294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4756bd-da9d-4ad6-9385-84494a7dfcf9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.564611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958953f4-8f30-4f17-b3bc-0beb624874f7 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.573518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:23.593409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.594058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.594338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.594609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.595253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.596692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.598634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.599255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.599529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.599795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] PATH_INFO: `/v3/users/f007e87391d84c88aa86b31795c5e1f7` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.607711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:23.614103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] RBAC: Authorizing `identity:get_user(user_id=f007e87391d84c88aa86b31795c5e1f7)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.616123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.618660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 111/216] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/users/f007e87391d84c88aa86b31795c5e1f7 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:23.619723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.637771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 106/217] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:23 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:23.637771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.740773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4509e5-8899-4c59-b8ac-ea86a3b3ef73 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.741108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d214a-8e41-455e-9766-93b0688e1773 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.779682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.779898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.780300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.780426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.780580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.780673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.780837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.780930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.781516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:23.781610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] RBAC: Adding query filter params (role.id=ba67557ce74c431c93432833ee06b87f, user.id=f007e87391d84c88aa86b31795c5e1f7, scope.system=all) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:23.781851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.781946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.783267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.783377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.789394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 107/218] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/role_assignments?user.id=f007e87391d84c88aa86b31795c5e1f7&scope.system=all&role.id=ba67557ce74c431c93432833ee06b87f => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:23.793643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 112/219] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:23.799687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:23.870153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:23.920375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0d81-7d01-4757-ae03-53cc3064f092 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:23.960808 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:23.961450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:23.961730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:23.962166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] PATH_INFO: `/v3/users/9a9658a4e4a2431e92bc465fb4588cad` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:23.963500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] RBAC: Authorizing `identity:get_user(user_id=9a9658a4e4a2431e92bc465fb4588cad)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:23.964972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:23.966797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 108/220] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/users/9a9658a4e4a2431e92bc465fb4588cad => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:23.972501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:24.005313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:24.083595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e846f0-4358-45a4-ae18-394392eddc0e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:24.119580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:24.120191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:24.120463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:24.120728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:24.190860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:24.192305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:24.219794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:24.303553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 113/221] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:24.309837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:24.413140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3f2c-ce2b-431c-853b-2b8877b0e89d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:24.441145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:24.450538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837cf58-47bf-4aee-a76f-8ca6de4eb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:24.451271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837cf58-47bf-4aee-a76f-8ca6de4eb631 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:24.451556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837cf58-47bf-4aee-a76f-8ca6de4eb631 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:24.451835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837cf58-47bf-4aee-a76f-8ca6de4eb631 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:24.453037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837cf58-47bf-4aee-a76f-8ca6de4eb631 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:24.454529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837cf58-47bf-4aee-a76f-8ca6de4eb631 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:24.456508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 109/222] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:24 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:24.462860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:24.568730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9244-b23a-48a5-9324-62f0284e6a85 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:24.598105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:24.604530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:24.605158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:24.605438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:24.605712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:24.606487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] RBAC: Adding query filter params (role.id=e179fa62b70f46c2aa5a556c0312b9e5, scope.project.id=46c60afb47644b7eb2c06c075a2525f9, user.id=9a9658a4e4a2431e92bc465fb4588cad) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:24.606794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:24.608233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531befa-75b0-4015-bd48-179e83e5ed47 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:24.614930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 114/223] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:24 2022] GET /identity/v3/role_assignments?user.id=9a9658a4e4a2431e92bc465fb4588cad&scope.project.id=46c60afb47644b7eb2c06c075a2525f9&role.id=e179fa62b70f46c2aa5a556c0312b9e5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:25.997502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33c042-c5c4-4388-be83-e01b2e98a3c9 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:25.998036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33c042-c5c4-4388-be83-e01b2e98a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:25.998108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33c042-c5c4-4388-be83-e01b2e98a3c9 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:25.999321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355724-9a6d-45dc-a5ea-91e35d6812e3 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:25.999688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355724-9a6d-45dc-a5ea-91e35d6812e3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:25.999807 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 110/224] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:25.999926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355724-9a6d-45dc-a5ea-91e35d6812e3 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.001213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 115/225] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:26.005605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b038-3f44-4b2c-b522-b8b0ea71a2bc None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.006000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b038-3f44-4b2c-b522-b8b0ea71a2bc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.006340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b038-3f44-4b2c-b522-b8b0ea71a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.006718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0db6-7d9f-421f-93da-ecbc7d65eee5 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.007005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0db6-7d9f-421f-93da-ecbc7d65eee5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.007281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0db6-7d9f-421f-93da-ecbc7d65eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.026260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b409b038-3f44-4b2c-b522-b8b0ea71a2bc None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:26.026638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-777f0db6-7d9f-421f-93da-ecbc7d65eee5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:26.027457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b409b038-3f44-4b2c-b522-b8b0ea71a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:26.027789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-777f0db6-7d9f-421f-93da-ecbc7d65eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:26.098296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 111/226] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:26.102382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 116/227] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:26.106000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131a681-92d9-4c61-8308-55d258f50b5b None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.106287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131a681-92d9-4c61-8308-55d258f50b5b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.106563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131a681-92d9-4c61-8308-55d258f50b5b None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.107966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 112/228] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:26.113092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.113383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.113661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.131552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:26.132733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:26.205898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 117/229] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:26.361317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131a681-92d9-4c61-8308-55d258f50b5b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.370970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.425670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:26.466976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131a681-92d9-4c61-8308-55d258f50b5b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.480146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a1975-bc98-4fe9-a688-ea69154c1591 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.493999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:26.502872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.503503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.503784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.504054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.514836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:26.515104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.515725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.515998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.516266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:26.519702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:26.520753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 113/230] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:26.522612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.531362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:26.536136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:26.537017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:26.537799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 118/231] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:26.538460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.623673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881fc52-8249-4832-87d6-333f92650a0d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.636907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e41ee-c72a-4f6c-8739-099daa885d0d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.650391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:26.657292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.657946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.658222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.658499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.659591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:26.661033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:26.662618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 114/232] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:26.663411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.672196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.672800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.673074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.673338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.674018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:26.674321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:26.675688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:26.684317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 119/233] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:26.684942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.720296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:26.764362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b10a58-13bc-4c2c-a983-e0dc981ea388 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.782107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf036-a47a-4ba5-91db-47527328ab2f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.797392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.798016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.798292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.798556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.799212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:26.799502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:26.800860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:26.809797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 115/234] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:26.809922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.816417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.817025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.817302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.817567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] PATH_INFO: `/v3/groups` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.818215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:26.819629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:26.835665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 120/235] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Oct 20 05:49:26 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:26.836469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:26.874546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:26.927938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cf34c-17d9-445b-bb89-7700330b31bd None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.950724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:26.961529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ecbc4-57c8-41e9-84a3-01fd1a6ef2c5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:26.971928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:26.972914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:26.973390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:26.973758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] PATH_INFO: `/v3/users/d5e03934ab304ffdb7d191f2a41eb16f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:26.996138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e03934ab304ffdb7d191f2a41eb16f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:26.997793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:27.004426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 116/236] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/users/d5e03934ab304ffdb7d191f2a41eb16f => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:27.005067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:27.005497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:27.006332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:27.006612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:27.006882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] PATH_INFO: `/v3/users/f007e87391d84c88aa86b31795c5e1f7` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:27.008027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] RBAC: Authorizing `identity:get_user(user_id=f007e87391d84c88aa86b31795c5e1f7)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:27.009510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:27.012292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 121/237] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:26 2022] GET /identity/v3/users/f007e87391d84c88aa86b31795c5e1f7 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:27.016896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:27.115596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc0a35-587a-4f34-9df6-af6a21e7d354 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:27.131740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3315-e261-4233-9168-65b463c15d53 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:27.133313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:27.152367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:27.152972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:27.153247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:27.153515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:27.154275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] RBAC: Adding query filter params (role.id=e179fa62b70f46c2aa5a556c0312b9e5, user.id=d5e03934ab304ffdb7d191f2a41eb16f, scope.system=all) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:27.154580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:27.156089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ee85-a3cc-41f0-b583-05da67869a7c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:27.161542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 117/238] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 05:49:27 2022] GET /identity/v3/role_assignments?user.id=d5e03934ab304ffdb7d191f2a41eb16f&scope.system=all&role.id=e179fa62b70f46c2aa5a556c0312b9e5 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:27.175103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20101ba7-bb34-41cb-829f-811fe9aa65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:27.175853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20101ba7-bb34-41cb-829f-811fe9aa65e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:27.176136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20101ba7-bb34-41cb-829f-811fe9aa65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:27.176415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20101ba7-bb34-41cb-829f-811fe9aa65e1 None admin] PATH_INFO: `/v3/system/users/f007e87391d84c88aa86b31795c5e1f7/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:27.177982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20101ba7-bb34-41cb-829f-811fe9aa65e1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f007e87391d84c88aa86b31795c5e1f7, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:27.179501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20101ba7-bb34-41cb-829f-811fe9aa65e1 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:27.192426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 122/239] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Oct 20 05:49:27 2022] PUT /identity/v3/system/users/f007e87391d84c88aa86b31795c5e1f7/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:49:29.008015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a824f-957e-4173-a6c9-336a05c1a236 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.008498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a824f-957e-4173-a6c9-336a05c1a236 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.008569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a824f-957e-4173-a6c9-336a05c1a236 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.010687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 118/240] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:29.015894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc4796-5d1a-4f1c-b4f9-e5319dcdeb6b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.016274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc4796-5d1a-4f1c-b4f9-e5319dcdeb6b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.016424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc4796-5d1a-4f1c-b4f9-e5319dcdeb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.034500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1afc4796-5d1a-4f1c-b4f9-e5319dcdeb6b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:29.035659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1afc4796-5d1a-4f1c-b4f9-e5319dcdeb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:29.103458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 123/241] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:29.306875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a28b-0f1c-45fa-adbb-a6e430e041d0 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.306875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a28b-0f1c-45fa-adbb-a6e430e041d0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.306875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a28b-0f1c-45fa-adbb-a6e430e041d0 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.308069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 119/242] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:29.313054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6432ba-6bd7-4bc5-acd8-2b7dc1437aaa None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.313340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6432ba-6bd7-4bc5-acd8-2b7dc1437aaa None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.313613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6432ba-6bd7-4bc5-acd8-2b7dc1437aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.332293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ea6432ba-6bd7-4bc5-acd8-2b7dc1437aaa None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:29.333475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ea6432ba-6bd7-4bc5-acd8-2b7dc1437aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:29.371259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56b77-04bb-4c8a-9e00-c4cd84a8cad1 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.371554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56b77-04bb-4c8a-9e00-c4cd84a8cad1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.371809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56b77-04bb-4c8a-9e00-c4cd84a8cad1 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.373464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 120/243] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:29.374267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b56b77-04bb-4c8a-9e00-c4cd84a8cad1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:29.400543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 124/244] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:29.401792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.402077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.402347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.418970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:29.419516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:29.420903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:29.443049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:29.485195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b56b77-04bb-4c8a-9e00-c4cd84a8cad1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:29.499169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 125/245] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:29.521127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:29.521773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.522045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.522309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.523380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:29.524891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:29.526463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 121/246] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:29.531886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:29.630833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ca1d-e467-4db7-a277-f18ca12784c9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:29.667520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:29.668134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.668415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.668684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] PATH_INFO: `/v3/groups` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.668856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:29.669314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:29.670758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:29.689882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 126/247] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Oct 20 05:49:29 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 05:49:29.777308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136ebc-930d-4cac-a999-1611efa0d726 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:29.780574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:29.786161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:29.800867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:29.818814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:29.819488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.819764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.820033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.833030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:29.838074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:29.839211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:29.842784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 122/248] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:29.845572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:29.909215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec991-595e-4648-b770-01fcfb6e973c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:29.951609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:29.952822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:29.953646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:29.954436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:29.960928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad606-efd2-4843-ad25-113300832d7b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:29.978503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:29.985609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:29.986761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:29.987567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 127/249] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:29.998322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:30.012563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:30.014151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:30.014758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:30.015098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:30.015857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:30.016188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:30.017651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:30.029866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 123/250] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:30.035779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:30.069359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:30.107582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:30.142761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4d5f-3282-4f61-9d04-d545e4751e99 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:30.168582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd02f-e0ff-4d3b-a2a3-5c7f47c9cab7 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:30.187871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:30.188601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:30.188950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:30.189284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:30.190151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:30.190520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:30.191987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:30.203049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 128/251] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:30.214956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:30.219785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:30.220451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:30.220735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:30.221062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] PATH_INFO: `/v3/users/d5e03934ab304ffdb7d191f2a41eb16f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:30.222433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] RBAC: Authorizing `identity:get_user(user_id=d5e03934ab304ffdb7d191f2a41eb16f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:30.224763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:30.231157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 124/252] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:30 2022] GET /identity/v3/users/d5e03934ab304ffdb7d191f2a41eb16f => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:30.233609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:30.351358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:30.363447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8bae4-5700-4aa1-887c-e8d9e983679f None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:30.368881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c37da3-0044-4775-b411-322a9aab73e9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:30.413633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:30.414661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:30.415100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:30.415458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] PATH_INFO: `/v3/users/f007e87391d84c88aa86b31795c5e1f7` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:30.415875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e34d-843e-45d5-99cf-d9ab7366dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:30.416689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e34d-843e-45d5-99cf-d9ab7366dd59 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:30.416888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] RBAC: Authorizing `identity:get_user(user_id=f007e87391d84c88aa86b31795c5e1f7)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:30.417259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e34d-843e-45d5-99cf-d9ab7366dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:30.417688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e34d-843e-45d5-99cf-d9ab7366dd59 None admin] PATH_INFO: `/v3/system/users/d5e03934ab304ffdb7d191f2a41eb16f/roles/e179fa62b70f46c2aa5a556c0312b9e5` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:30.418777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:30.419498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718e34d-843e-45d5-99cf-d9ab7366dd59 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5e03934ab304ffdb7d191f2a41eb16f, role_id=e179fa62b70f46c2aa5a556c0312b9e5)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:30.420667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 129/253] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:30 2022] GET /identity/v3/users/f007e87391d84c88aa86b31795c5e1f7 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:30.421583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718e34d-843e-45d5-99cf-d9ab7366dd59 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:30.427965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:30.439653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 125/254] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Oct 20 05:49:30 2022] PUT /identity/v3/system/users/d5e03934ab304ffdb7d191f2a41eb16f/roles/e179fa62b70f46c2aa5a556c0312b9e5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:49:30.442793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:30.561473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a82bf-14c2-4cac-a364-140ccd3c3076 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:30.608066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:30.608836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:30.609207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:30.609574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:30.610533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] RBAC: Adding query filter params (role.id=ba67557ce74c431c93432833ee06b87f, user.id=f007e87391d84c88aa86b31795c5e1f7, scope.system=all) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:30.610991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:30.612572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7243-50d3-4073-8000-269d77e853c4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:30.628991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 130/255] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 05:49:30 2022] GET /identity/v3/role_assignments?user.id=f007e87391d84c88aa86b31795c5e1f7&scope.system=all&role.id=ba67557ce74c431c93432833ee06b87f => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:32.159384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8eb54-999f-4b55-93cd-a550d3f0ecd6 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.160372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8eb54-999f-4b55-93cd-a550d3f0ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.160890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8eb54-999f-4b55-93cd-a550d3f0ecd6 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.162741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 126/256] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:32.175187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e03fb-67a8-4d36-a63a-d84a851c11c6 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.175651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e03fb-67a8-4d36-a63a-d84a851c11c6 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.175726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e03fb-67a8-4d36-a63a-d84a851c11c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.198795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-919e03fb-67a8-4d36-a63a-d84a851c11c6 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:32.199999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-919e03fb-67a8-4d36-a63a-d84a851c11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:32.272798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 131/257] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 05:49:32.735948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cbb02-dfed-4b29-b2e5-db4fcd70895d None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.736603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cbb02-dfed-4b29-b2e5-db4fcd70895d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.737120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cbb02-dfed-4b29-b2e5-db4fcd70895d None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.738967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 127/258] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:32.744499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.745025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.745496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.768985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:32.770617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:32.779488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 132/259] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 05:49:32.852014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cbb02-dfed-4b29-b2e5-db4fcd70895d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:32.867449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cbb02-dfed-4b29-b2e5-db4fcd70895d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:32.872416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:32.873296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.873798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.874270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.886827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:32.892327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:32.893194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:32.894035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:32.898884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:32.902054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:32.908335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:32.912974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377d666-c67f-4058-84d0-19a5173148d2 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:32.924808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:32.925698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.926198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.926668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.927639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:32.928178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:32.930174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:49:32.930174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 05:49:32.930174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 05:49:32.931509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:32.944477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 133/261] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:32.950626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:32.961165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6eea5-b6e2-43f7-a296-3768a01bd680 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:32.969813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:32.970742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:32.971261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:32.971737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:32.979869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:32.982000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:49:32.982000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:49:32.982000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:49:32.983519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:32.985080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 129/262] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 05:49:32 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:32.990469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.002865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d1c4-2338-4e35-9aab-735717cd3d8c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.009372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf8b8b-e81d-4810-8bd2-d498911df91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.010054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf8b8b-e81d-4810-8bd2-d498911df91a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.010325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf8b8b-e81d-4810-8bd2-d498911df91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.010587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf8b8b-e81d-4810-8bd2-d498911df91a admin admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.014697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf8b8b-e81d-4810-8bd2-d498911df91a admin admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.016792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf8b8b-e81d-4810-8bd2-d498911df91a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.018871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 134/263] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 05:49:32 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:33.024650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.035006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093cd5d-78ba-4fd8-9883-7678c97f7334 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.045949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.046659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.046954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.047218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619/groups/466a20fb9505491db4347d042f0c5fbd/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.049187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] RBAC: Authorizing `identity:create_grant(project_id=921d232f84fb4aba890912996255f619, group_id=466a20fb9505491db4347d042f0c5fbd, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.050278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:49:33.050278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:49:33.050278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:49:33.052455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16bc46-f03f-4987-87a5-02fd93a0744f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.079069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 05:49:33 2022] PUT /identity/v3/projects/921d232f84fb4aba890912996255f619/groups/466a20fb9505491db4347d042f0c5fbd/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:33.242226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4486079-69ee-4c69-ba4b-392b8bd73b94 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.242727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4486079-69ee-4c69-ba4b-392b8bd73b94 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.242727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4486079-69ee-4c69-ba4b-392b8bd73b94 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.244960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 135/265] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:33.250464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.251084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.251084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.279055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:33.280282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:33.288973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4486079-69ee-4c69-ba4b-392b8bd73b94 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.375651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 131/266] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 05:49:33.413340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4486079-69ee-4c69-ba4b-392b8bd73b94 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.420142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659383f-2d36-4ef9-8ea0-a04d49dd2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.420779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659383f-2d36-4ef9-8ea0-a04d49dd2888 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.421060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659383f-2d36-4ef9-8ea0-a04d49dd2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.421330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659383f-2d36-4ef9-8ea0-a04d49dd2888 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.434456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659383f-2d36-4ef9-8ea0-a04d49dd2888 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c659383f-2d36-4ef9-8ea0-a04d49dd2888 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:33.439813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:33.440678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:33.441460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 136/267] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:33.447182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.457735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f14bd-a38f-4330-8f36-fb89647b6716 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.458057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f14bd-a38f-4330-8f36-fb89647b6716 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.458306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f14bd-a38f-4330-8f36-fb89647b6716 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.460781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9dbf3-a22a-42d5-9715-aa13d55dfbe5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.462071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 137/268] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:33.465132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.465413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.465682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.471698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.472316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.472585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.472869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.473533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:33.473866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.474892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:49:33.474892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:49:33.474892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:49:33.475772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.502835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 132/269] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:33.504526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:33.505753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:33.508214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.524951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d1fc-0a54-4104-9e2b-05326132e7e8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.539934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.540713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.540997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.541270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.542545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.544483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.546111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 133/270] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:33.551382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.575150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183cdf-c1b5-4388-8a06-3c2db20bde21 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.584143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.584773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.585053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.585326 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.588417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.590548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.592190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 134/271] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:33.599383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.625044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05172609-13cd-4dfd-883e-d3bcd2961bc0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.638371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.639299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.639582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.639861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619/groups/466a20fb9505491db4347d042f0c5fbd/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.643808 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921d232f84fb4aba890912996255f619, group_id=466a20fb9505491db4347d042f0c5fbd, role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.646534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.664494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 138/272] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:33.672111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 135/273] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 05:49:33 2022] PUT /identity/v3/projects/921d232f84fb4aba890912996255f619/groups/466a20fb9505491db4347d042f0c5fbd/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:33.757820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.843732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec712-1fc2-4ff6-be0a-459b6e7913c8 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.850737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.851408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.851695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.851968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.861718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:33.866078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:33.874598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:33.875534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:33.876332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 139/274] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:33.881788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.896310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9610-eebb-4848-a81c-5c35a87f0505 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.907623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.908317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.908596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.908861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.909557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:33.909936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.911610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.927471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:33.932978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.947089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2b16b-43f7-4777-b5bc-6c6c5adad073 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.957045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.957703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.958007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.958286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.962512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.963562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:49:33.963562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 05:49:33.963562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 05:49:33.964807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:33.969770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:33.972328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:33.985390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405bdd-523a-4546-bed2-f325493cacf7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:33.995029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:33.995740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:33.996013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:33.996333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:33.997513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:33.999704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:34.001399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 137/277] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 05:49:33 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:34.007425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:34.023687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a348d-6481-4a07-b7ba-78ad4dee14f4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:34.034520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:34.035221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:34.035503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:34.035782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9/groups/466a20fb9505491db4347d042f0c5fbd/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:34.037831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c60afb47644b7eb2c06c075a2525f9, group_id=466a20fb9505491db4347d042f0c5fbd, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:34.038868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:49:34.038868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 05:49:34.038868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 05:49:34.040918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:34.065920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 141/278] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 05:49:34 2022] PUT /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9/groups/466a20fb9505491db4347d042f0c5fbd/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:34.181377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:34.218012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:34.301587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb11b-b301-44ed-80bd-72f10b5cfd95 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:34.342094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:34.343093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:34.343629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:34.344098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:34.356028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:34.361566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:34.362480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 05:49:34.363274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:34.368177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 138/279] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:34.371502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:34.483026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395567-261c-46ea-ba03-0c69589e6b28 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:34.519308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:34.520277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:34.520765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:34.521289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:34.522192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:34.522718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:34.524448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:34.536475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 142/280] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:34.542416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:34.683570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:34.701017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8dcf5-4b7e-4451-aa9e-1e5fac27ebaa None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:34.744608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7075778-957b-4f57-b429-a06f6cb7f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:34.745244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7075778-957b-4f57-b429-a06f6cb7f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:34.745519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7075778-957b-4f57-b429-a06f6cb7f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:34.745809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7075778-957b-4f57-b429-a06f6cb7f5f3 None admin] PATH_INFO: `/v3/users/d5e03934ab304ffdb7d191f2a41eb16f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:34.747054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7075778-957b-4f57-b429-a06f6cb7f5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e03934ab304ffdb7d191f2a41eb16f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:34.748541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7075778-957b-4f57-b429-a06f6cb7f5f3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:34.750489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 139/281] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:49:34 2022] GET /identity/v3/users/d5e03934ab304ffdb7d191f2a41eb16f => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:34.755935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:34.819345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:34.885384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44891-1be5-4423-b436-59548d743f8b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:34.925707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:34.926371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:34.926652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:34.926924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:34.927680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] RBAC: Adding query filter params (role.id=e179fa62b70f46c2aa5a556c0312b9e5, user.id=d5e03934ab304ffdb7d191f2a41eb16f, scope.system=all) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:34.927994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:34.929483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e1151-c11c-4611-b72f-076fc2e394d1 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:34.944043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 143/282] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 05:49:34 2022] GET /identity/v3/role_assignments?user.id=d5e03934ab304ffdb7d191f2a41eb16f&scope.system=all&role.id=e179fa62b70f46c2aa5a556c0312b9e5 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:35.040605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07593c-f92a-42be-b1bd-d5ee25c9acdc None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.040883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07593c-f92a-42be-b1bd-d5ee25c9acdc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.041154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07593c-f92a-42be-b1bd-d5ee25c9acdc None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.043028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 140/283] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:35.048854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e215f2-5414-4635-8856-6f462f1ffcde None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.049136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e215f2-5414-4635-8856-6f462f1ffcde None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.049412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e215f2-5414-4635-8856-6f462f1ffcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.070406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-08e215f2-5414-4635-8856-6f462f1ffcde None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:35.072201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-08e215f2-5414-4635-8856-6f462f1ffcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:35.138330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 144/284] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 05:49:35.146266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea598dc-0ad3-4fb1-b64e-06aae5ad42d0 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.146570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea598dc-0ad3-4fb1-b64e-06aae5ad42d0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.146823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea598dc-0ad3-4fb1-b64e-06aae5ad42d0 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.148262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 141/285] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:35.153844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.154134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.154409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.186924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:35.188240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:35.197095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 145/286] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 20 05:49:35.546707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea598dc-0ad3-4fb1-b64e-06aae5ad42d0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.567321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea598dc-0ad3-4fb1-b64e-06aae5ad42d0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.571792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.572431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.572706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.572975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.589102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:35.598108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:35.598983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:35.599763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 142/287] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:35.605425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.620722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1d31-f4fb-4a68-907d-831187e37e5b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.627013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.627697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.627979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.628386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.629056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:35.629354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.635172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.638300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.645191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 146/288] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:35.651942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.653863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c4f8-2073-4284-a736-6c988dd47cc9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.663063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.663708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.663985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.664253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.668544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba421f-dbb4-43d3-9f37-190649ce152b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.674772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.675656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.676182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.676641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] PATH_INFO: `/v3/groups/89f8c4de48b84eeb9e18604cebed095e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.684752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] RBAC: Authorizing `identity:get_group(group_id=89f8c4de48b84eeb9e18604cebed095e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.687019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.689583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 147/289] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/groups/89f8c4de48b84eeb9e18604cebed095e => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:35.694918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:35.695473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:35.700015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:35.700903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:35.701692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 143/290] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:35.707013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.709283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af31b-69c9-4979-ae44-220583253142 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.714759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.715590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.716005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.716463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] PATH_INFO: `/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.717829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] RBAC: Authorizing `identity:get_project(project_id=34e0c1ea686742ad9b5478d4dbdbb4cc)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.719920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.721720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 148/291] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:35.727354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.728868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a0d4f-acd2-48da-8260-f791d6dcbabe admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.737965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c654d-f4fa-4959-9310-476557329107 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.742348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.745039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.745503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.746159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.746621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.747240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.747513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.748590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] PATH_INFO: `/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc/groups/89f8c4de48b84eeb9e18604cebed095e/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.749572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:35.750074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.752089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e0c1ea686742ad9b5478d4dbdbb4cc, group_id=89f8c4de48b84eeb9e18604cebed095e, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.753899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.757178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.769313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 144/292] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:35.775621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.786190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 149/293] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 05:49:35 2022] PUT /identity/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc/groups/89f8c4de48b84eeb9e18604cebed095e/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:49:35.787497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6050ae-3b1b-484c-bb52-957973e77f4f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.877814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.878780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.879233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.879642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.880971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.883158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.885731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 145/294] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:35.891730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.904680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793f57-921b-4ec7-a933-8fb9a252bf88 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.909526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb92954-66d2-433f-9dbb-6de7cba8e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.910422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb92954-66d2-433f-9dbb-6de7cba8e609 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.910867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb92954-66d2-433f-9dbb-6de7cba8e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.911289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb92954-66d2-433f-9dbb-6de7cba8e609 admin admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.912660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb92954-66d2-433f-9dbb-6de7cba8e609 admin admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.915582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb92954-66d2-433f-9dbb-6de7cba8e609 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.917932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 150/295] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 05:49:35 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:35.925401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:35.936527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b03d-3a86-4757-9c86-b4c79541a94c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:35.941318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4aa3-2c60-4418-a083-0928c30b9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:35.942187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4aa3-2c60-4418-a083-0928c30b9071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:35.942673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4aa3-2c60-4418-a083-0928c30b9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:35.943085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4aa3-2c60-4418-a083-0928c30b9071 admin admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9/groups/466a20fb9505491db4347d042f0c5fbd/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:35.945455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba4aa3-2c60-4418-a083-0928c30b9071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c60afb47644b7eb2c06c075a2525f9, group_id=466a20fb9505491db4347d042f0c5fbd, role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:35.952719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba4aa3-2c60-4418-a083-0928c30b9071 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:35.974113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 146/296] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 05:49:35 2022] PUT /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9/groups/466a20fb9505491db4347d042f0c5fbd/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:36.749676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee377a-2208-4cab-98a5-c68209fc7bbe None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:36.750558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee377a-2208-4cab-98a5-c68209fc7bbe None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:36.750974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee377a-2208-4cab-98a5-c68209fc7bbe None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:36.752899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 151/297] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:36.767922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58b6a-284e-4dd4-b1ed-cb38930f3c69 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:36.768810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58b6a-284e-4dd4-b1ed-cb38930f3c69 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:36.769270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58b6a-284e-4dd4-b1ed-cb38930f3c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:36.795726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1ae58b6a-284e-4dd4-b1ed-cb38930f3c69 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:36.797242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1ae58b6a-284e-4dd4-b1ed-cb38930f3c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:36.861418 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580f9f-a192-40b9-b9bd-635b10f4f68d None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:36.861818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580f9f-a192-40b9-b9bd-635b10f4f68d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:36.862168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580f9f-a192-40b9-b9bd-635b10f4f68d None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:36.863800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 152/298] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:36.869768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcfd88-34c6-473a-826f-081d02e38965 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:36.870144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcfd88-34c6-473a-826f-081d02e38965 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:36.873117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcfd88-34c6-473a-826f-081d02e38965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:36.875636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:36.886498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:36.893823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 147/299] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:36.902751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-77fcfd88-34c6-473a-826f-081d02e38965 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:36.903947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-77fcfd88-34c6-473a-826f-081d02e38965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:37.018644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 153/300] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:37.054216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77775bd8-5caf-4565-83a5-4c84675536de None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:37.054535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77775bd8-5caf-4565-83a5-4c84675536de None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:37.054758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77775bd8-5caf-4565-83a5-4c84675536de None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:37.056146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 148/301] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:37.062743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:37.063025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:37.063300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:37.083491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:37.084676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:37.155818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 154/302] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:37.433831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77775bd8-5caf-4565-83a5-4c84675536de None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:37.463505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:37.558860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:37.590982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77775bd8-5caf-4565-83a5-4c84675536de None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:37.612847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba629-d763-4d03-8e7e-982789d16642 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:37.630056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:37.630809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:37.631067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:37.631451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:37.645696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:37.650874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:37.651766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:37.652549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:37.655531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 149/303] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:37.656353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:37.667811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:37.668761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:37.669247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:37.670253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:37.685489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:37.693008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:37.693893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 05:49:37.694680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:37.695837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 155/304] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:37.701278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:37.727442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:37.794720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6348a-8639-4135-8a32-8b6db0668080 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:37.826869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a5d3d-e105-44c9-a42c-1e3ddcb8f14c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:37.835498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:37.836149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:37.836425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:37.836693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:37.848543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:37.853527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:37.854444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:37.855223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 150/305] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:37.855866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:37.864647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:37.878435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:37.879713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:37.880202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:37.880683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:37.882475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] RBAC: Adding query filter params (name=member) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:37.882980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:37.886074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:37.898333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 156/306] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:37.899979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:37.989059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ea34-2c0b-4774-810b-13d791559c26 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.002514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.030796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.031195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.031475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.031740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.032406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] RBAC: Adding query filter params (name=member) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:38.032701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.034152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.043304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 151/307] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:38.044164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.052504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01a62-bccd-4bf6-994d-ec8c5ac54946 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.095064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.096108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.096610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.097118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.098016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:38.098574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.100140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.112335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 157/308] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:38.113011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.178373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.180955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4e5a-2397-4b35-a097-97338381de32 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.223707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.224320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.224600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.224870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.245687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c7adf-be42-4e58-ba8d-1f803c446331 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.279779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.286963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.287872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.288347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.288815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.311333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.312818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.367413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.370053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.418615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 152/309] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:38.419314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.430171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.489848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 158/310] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:38.491138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.494927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.530178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d0e9e-1e8f-4373-a9c4-e38fc9d48899 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.568281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2e62-12b0-42fd-877c-e4ddfa3cb0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.569161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2e62-12b0-42fd-877c-e4ddfa3cb0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.569580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2e62-12b0-42fd-877c-e4ddfa3cb0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.570017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2e62-12b0-42fd-877c-e4ddfa3cb0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.609860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09e83-52a9-4002-a0f2-91e4bdc48fb8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.653458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.653865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2e62-12b0-42fd-877c-e4ddfa3cb0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.654393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.654763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.655129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.656103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2e62-12b0-42fd-877c-e4ddfa3cb0d1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.656472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.658044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.660236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 159/311] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:38.660541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.683567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.736898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.771832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 153/312] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:38.773505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3601d8-e628-4960-a99f-8daa47ba583e None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.773505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3601d8-e628-4960-a99f-8daa47ba583e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.773672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3601d8-e628-4960-a99f-8daa47ba583e None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.775539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 154/313] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:38.776106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3601d8-e628-4960-a99f-8daa47ba583e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.786478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa7a9-0a30-41f3-a1d4-a477ce258652 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.828991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229c63-6aea-40f4-849c-ed72c614e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.829670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229c63-6aea-40f4-849c-ed72c614e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.830869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229c63-6aea-40f4-849c-ed72c614e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.830869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229c63-6aea-40f4-849c-ed72c614e4b8 None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.831921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229c63-6aea-40f4-849c-ed72c614e4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.833267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229c63-6aea-40f4-849c-ed72c614e4b8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.834485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 160/314] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:38.835525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a388a-21e5-44b9-b5ef-864b7ac98288 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.835797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a388a-21e5-44b9-b5ef-864b7ac98288 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.836064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a388a-21e5-44b9-b5ef-864b7ac98288 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.837301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 161/315] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:38.839163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a388a-21e5-44b9-b5ef-864b7ac98288 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:38.900859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3601d8-e628-4960-a99f-8daa47ba583e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.939092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:38.943340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80554442-9560-4741-a935-4c5cd602e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:38.943983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80554442-9560-4741-a935-4c5cd602e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.944451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80554442-9560-4741-a935-4c5cd602e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.944563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80554442-9560-4741-a935-4c5cd602e9c2 None admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.945722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80554442-9560-4741-a935-4c5cd602e9c2 None admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:38.947403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80554442-9560-4741-a935-4c5cd602e9c2 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:38.949287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 155/316] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:38.950367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc89259-b322-4a9e-8c97-1d110d9d7145 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:38.950645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc89259-b322-4a9e-8c97-1d110d9d7145 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:38.951021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc89259-b322-4a9e-8c97-1d110d9d7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:38.958092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a388a-21e5-44b9-b5ef-864b7ac98288 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:38.969821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4fc89259-b322-4a9e-8c97-1d110d9d7145 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:38.971019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4fc89259-b322-4a9e-8c97-1d110d9d7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:39.008404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.009922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.010204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.010481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] PATH_INFO: `/v3/projects/921d232f84fb4aba890912996255f619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.011632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] RBAC: Authorizing `identity:get_project(project_id=921d232f84fb4aba890912996255f619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:39.012435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.013444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:39.015665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 162/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:38 2022] GET /identity/v3/projects/921d232f84fb4aba890912996255f619 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:39.017048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.051978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 156/318] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:39.053266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.053550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.053854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.074549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:39.075726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:39.130523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0fdc8-dc3b-45d5-a6c0-b62de11ebc0d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.160571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 157/319] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:39.161488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.178137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.178774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.179054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.179327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.180571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:39.182239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:39.184205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 163/320] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:39.185158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.215156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.294653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.301067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c595b-aae6-4349-95aa-708351baace4 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.305270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f415fa-adb5-4746-95ff-962b5d01840b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.343761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.344372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.344641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.344913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.345651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] RBAC: Adding query filter params (group.id=466a20fb9505491db4347d042f0c5fbd, role.id=ba67557ce74c431c93432833ee06b87f, scope.project.id=46c60afb47644b7eb2c06c075a2525f9) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:39.345776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.346018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:39.346461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.346739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.347004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.347467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:39.348107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:39.349529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:39.351250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 164/321] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:39.351866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.353910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 158/322] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/role_assignments?group.id=466a20fb9505491db4347d042f0c5fbd&scope.project.id=46c60afb47644b7eb2c06c075a2525f9&role.id=ba67557ce74c431c93432833ee06b87f => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:39.354593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.466767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.483276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a31b-1217-489f-ada7-2849e3856abd None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.524831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8798e-964e-449c-9d07-04d56843d1c0 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.541980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.542602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.542879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.543147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.543950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] RBAC: Adding query filter params (group.id=466a20fb9505491db4347d042f0c5fbd, role.id=ba67557ce74c431c93432833ee06b87f, scope.project.id=921d232f84fb4aba890912996255f619) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:39.544186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:39.545728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:39.557851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 165/323] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/role_assignments?group.id=466a20fb9505491db4347d042f0c5fbd&scope.project.id=921d232f84fb4aba890912996255f619&role.id=ba67557ce74c431c93432833ee06b87f => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:39.557851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.577714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.578397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.578683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.578957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.596735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:39.603823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:39.604778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:39.605581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 159/324] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:39.606432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.645579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.718837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f3170-3e77-45a5-be11-2dc061dfcd89 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.745224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fec2e9-f8cd-453f-8e39-f14fd10f64cb None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.765680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.766347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.766783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.767060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.768108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] RBAC: Adding query filter params (group.id=466a20fb9505491db4347d042f0c5fbd, role.id=b73e3a3a46cf4bfaaffedeae6ece231e, scope.project.id=921d232f84fb4aba890912996255f619) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:39.768421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:39.769906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:39.785869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 166/325] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/role_assignments?group.id=466a20fb9505491db4347d042f0c5fbd&scope.project.id=921d232f84fb4aba890912996255f619&role.id=b73e3a3a46cf4bfaaffedeae6ece231e => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:39.787007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.788475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.789141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.789419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:39.789971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:39.802976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:39.809076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:39.810030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:39.815435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 160/326] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:39.816138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.823135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:39.934126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:39.944328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a36d-41b9-415b-b700-38277b4adfb0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.957281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410474-9d9e-459e-be36-3c990338a106 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:39.999039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:39.999665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:39.999936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.000406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.000881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:40.001189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.002636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.010420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.011036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.011316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.011590 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.012263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:40.012993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.013241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 167/327] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:40.013976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.019684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.025805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 161/328] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:40.031753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.121256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.143429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21116f36-ea04-41e9-81dd-fad4161bafe4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.153076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab906e-549b-42f6-acb7-46aad06cecb4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.187668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.188278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.188551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.188822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.194977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.195583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.195857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.196147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.217960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.276819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.278653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.278971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.280652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.368138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.392698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 168/329] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 05:49:40.398370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 162/330] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 05:49:40.398667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.403949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.449255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.495059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2efe9-8eaf-4907-9dba-14ee84949871 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.500704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a886b-ac32-4946-a1d2-3bbc0b51000d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.528716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.529429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.529717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.530018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] PATH_INFO: `/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.531144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] RBAC: Authorizing `identity:get_project(project_id=34e0c1ea686742ad9b5478d4dbdbb4cc)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.532573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.533706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.534240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/projects/34e0c1ea686742ad9b5478d4dbdbb4cc => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:40.534360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.534639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.534907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] PATH_INFO: `/v3/projects/46c60afb47644b7eb2c06c075a2525f9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.536005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] RBAC: Authorizing `identity:get_project(project_id=46c60afb47644b7eb2c06c075a2525f9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.537425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.543785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/projects/46c60afb47644b7eb2c06c075a2525f9 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:40.543911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.545575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.588815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.640185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aec16-2e91-45ef-8e3f-287ae3cc17a4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.643821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c555e9d-57b9-4fc7-a275-a91e6f97c711 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.657557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.674422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.675044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.675319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.675590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] PATH_INFO: `/v3/groups/89f8c4de48b84eeb9e18604cebed095e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.676679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] RBAC: Authorizing `identity:get_group(group_id=89f8c4de48b84eeb9e18604cebed095e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.677669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.678143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.678310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.678581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.678846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] PATH_INFO: `/v3/groups/466a20fb9505491db4347d042f0c5fbd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.679706 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/groups/89f8c4de48b84eeb9e18604cebed095e => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:40.679916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] RBAC: Authorizing `identity:get_group(group_id=466a20fb9505491db4347d042f0c5fbd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.681397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.682947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 164/334] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/groups/466a20fb9505491db4347d042f0c5fbd => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:40.685947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.688435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:40.783395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ffd78-1e8e-4ba9-8f1b-3e67d7fa0b59 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.786405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f600-6447-46c7-b588-7ac117c3a58d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:40.799340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:40.817317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.817936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.818212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.818476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.819187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] RBAC: Adding query filter params (group.id=89f8c4de48b84eeb9e18604cebed095e, role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=34e0c1ea686742ad9b5478d4dbdbb4cc) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:40.819490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.819966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:40.820564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:40.820843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:40.820930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116e513-35e2-43d8-812f-2e82d7958533 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.821130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:40.822503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] RBAC: Adding query filter params (group.id=466a20fb9505491db4347d042f0c5fbd, role.id=b73e3a3a46cf4bfaaffedeae6ece231e, scope.project.id=46c60afb47644b7eb2c06c075a2525f9) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:40.822812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:40.824244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf367e8-26e1-4721-8884-24c2a536f76d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:40.827286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 171/335] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/role_assignments?group.id=89f8c4de48b84eeb9e18604cebed095e&scope.project.id=34e0c1ea686742ad9b5478d4dbdbb4cc&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:40.832399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 165/336] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 05:49:40 2022] GET /identity/v3/role_assignments?group.id=466a20fb9505491db4347d042f0c5fbd&scope.project.id=46c60afb47644b7eb2c06c075a2525f9&role.id=b73e3a3a46cf4bfaaffedeae6ece231e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:43.576910 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a627d18-e57f-4ef9-91b5-302c51c6d181 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:43.578026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a627d18-e57f-4ef9-91b5-302c51c6d181 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:43.578520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a627d18-e57f-4ef9-91b5-302c51c6d181 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:43.580754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 172/337] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:43.587989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff20517-dab1-431a-a35a-a5839eaff33c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:43.588941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff20517-dab1-431a-a35a-a5839eaff33c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:43.589413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff20517-dab1-431a-a35a-a5839eaff33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:43.621393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7ff20517-dab1-431a-a35a-a5839eaff33c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:43.623053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7ff20517-dab1-431a-a35a-a5839eaff33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:43.700180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:43.740440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 166/338] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:43.756951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdf057-28a7-4f84-b453-c31e338a84cb None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:43.757280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdf057-28a7-4f84-b453-c31e338a84cb None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:43.757490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdf057-28a7-4f84-b453-c31e338a84cb None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:43.759194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 173/339] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:43.765181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:43.765504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:43.765735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:43.794723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:43.795931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:43.883729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 167/340] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:44.147661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdf057-28a7-4f84-b453-c31e338a84cb None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.210001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.272269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdf057-28a7-4f84-b453-c31e338a84cb None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:44.314886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:44.315983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.316564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.317023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.319418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa8ab6-6006-46eb-8439-599007220094 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:44.328652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:44.331629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:44.334321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-8b30c4a3-21e1-4838-a1ef-ac5ad0619dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:44.352363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:44.353909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:44.354776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:44.354776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:44.354776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:44.361233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 174/341] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:44.361387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:44.361387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.361387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.361387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.364001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e2bd3-71b4-4bf7-a304-2c89a75d84bb None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.364280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e2bd3-71b4-4bf7-a304-2c89a75d84bb None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.364547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e2bd3-71b4-4bf7-a304-2c89a75d84bb None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.370740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 175/342] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:44.371376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e2bd3-71b4-4bf7-a304-2c89a75d84bb None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.375995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:44.377684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-b288c5e0-2321-4f32-9a0e-3cbe9d0d7a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:44.396364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:44.397281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:44.398241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:44.398241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:44.398241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:44.403933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 168/343] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:44.403933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.403933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.403933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.414066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:44.432442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:44.434282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:44.498791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e2bd3-71b4-4bf7-a304-2c89a75d84bb None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:44.520222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 169/344] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:44.521426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.558546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:44.562083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.562615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.563109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.563954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:44.564572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:44.566450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:44.597868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 176/345] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:44.603869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.690125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:44.715070 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d87ec-129e-4fc9-bf36-d5fbc23f4a6c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:44.774720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:44.775515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.775794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.776144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.776713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:44.777013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:44.778414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010b95-e433-4b91-aafc-10631fdad454 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:44.779211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:44.797009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 170/346] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:44.797009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ae650-a88c-45cf-84bd-3ed09b590a74 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.797009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ae650-a88c-45cf-84bd-3ed09b590a74 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.797009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ae650-a88c-45cf-84bd-3ed09b590a74 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.797009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 171/347] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:44.797009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ae650-a88c-45cf-84bd-3ed09b590a74 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.798793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a14847-9bb5-4225-bb83-e44a7821387d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:44.842317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1384-8f37-473e-b804-8c790f35a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:44.843350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1384-8f37-473e-b804-8c790f35a7aa None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.843842 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1384-8f37-473e-b804-8c790f35a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.844323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1384-8f37-473e-b804-8c790f35a7aa None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.845174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd1384-8f37-473e-b804-8c790f35a7aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:44.846858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd1384-8f37-473e-b804-8c790f35a7aa None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:44.869338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 177/348] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:44 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:44.869338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.869338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.869338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.900561 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:44.902142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:44.928365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ae650-a88c-45cf-84bd-3ed09b590a74 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:44.989608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14e1d0-9387-41dc-a33f-394042d2d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:44.991615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14e1d0-9387-41dc-a33f-394042d2d7d2 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:44.991615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14e1d0-9387-41dc-a33f-394042d2d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:44.991615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14e1d0-9387-41dc-a33f-394042d2d7d2 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:44.991615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14e1d0-9387-41dc-a33f-394042d2d7d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:44.992033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 178/349] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:44.993048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:44.993576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14e1d0-9387-41dc-a33f-394042d2d7d2 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.037467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 172/350] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:44 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:45.115043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:45.119538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6418c-0cc3-4979-94bc-1fb961b5d554 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.119820 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6418c-0cc3-4979-94bc-1fb961b5d554 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.120091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6418c-0cc3-4979-94bc-1fb961b5d554 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.126183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 173/351] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:45.127692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.127980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.128253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.137511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:45.148008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd89999-ad90-4a30-8b8a-3185f30378f2 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.150412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:45.151859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:45.195284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:45.196040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.197005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.197373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.211372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:45.213861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:45.234510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:45.235432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:45.236256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:45.236256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:45.236256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:45.236256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 179/352] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:45.242633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:45.243692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 174/353] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:45.321614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:45.362004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090ca3-d0be-456a-8a9b-12017a376ad0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.400526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:45.411757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:45.412374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.412655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.412929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.413578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:45.413918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:45.415994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.433489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 180/354] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:45.438894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:45.442412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f35ec-0170-4559-a074-18c9931c7f80 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.483945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:45.484701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.484920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.485234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.487243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:45.498720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:45.500207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:45.517068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:45.518076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:45.518921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:45.518921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:45.518921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:45.518921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 175/355] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:45.524876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:45.609086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a39c-31b7-42cf-8be8-686282623c08 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.650960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:45.651579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.651856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.652128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.652779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:45.654256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.655154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd632a78-a91b-463e-91bf-28742164b09e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.686965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 181/356] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:45 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:45.694410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:45.714514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:45.715263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.715550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.715826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.716504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:45.716809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:45.721041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.749711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 176/357] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:45.771710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:45.802158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:45.855648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:45.892229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3411ede-fa9b-4639-ac46-9b70508f6525 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.942990 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:45.943876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:45.944166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:45.944887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:45.945938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:45.948554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:45.951751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a462db-2394-4573-b2c8-93b6cbe75a40 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:45.963038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.sql.core [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 05:49:45.963038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 20 05:49:45.963038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [parameters: {'id': '8b3f861592b540bdbd0c9fa8bce3b7d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 20 05:49:45.963038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:49:45.972872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return ref.to_dict() Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:49:45.973722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application yield resource Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise self.value Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application session.commit() Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 05:49:45.974685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.flush() Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application compat.raise_( Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 05:49:45.975535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:49:45.976415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:49:45.977220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [parameters: {'id': '8b3f861592b540bdbd0c9fa8bce3b7d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:45.979889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 20 05:49:45.981080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:45.982182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 182/358] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 05:49:45 2022] POST /identity/v3/roles => generated 144 bytes in 287 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:45.985831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:46.007559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:46.008198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:46.008485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:46.008895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:46.010010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:46.011512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:46.044318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 177/359] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:45 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:46.116615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccae3a8-8945-47ce-bf2f-124d170f12ca None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:46.128992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:46.168334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ee821-fe6c-49cf-a0c4-3bd59c35ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:46.168985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ee821-fe6c-49cf-a0c4-3bd59c35ff31 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:46.169264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ee821-fe6c-49cf-a0c4-3bd59c35ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:46.169536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ee821-fe6c-49cf-a0c4-3bd59c35ff31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:46.185777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ee821-fe6c-49cf-a0c4-3bd59c35ff31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-976ee821-fe6c-49cf-a0c4-3bd59c35ff31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:46.191267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:46.192163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:46.192955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 183/360] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:46.198359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:46.320964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7471e9-c505-447e-a589-9aacf958bedc None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:46.329130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:46.359082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:46.359990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:46.360406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:46.360812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:46.361617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:46.362087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:46.363578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bca24a-e97f-43be-a045-b73291e84aaf None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:46.373153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 178/361] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:47.569136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d8c5-4823-470e-b46c-d93f3eb8bc1f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:47.570112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d8c5-4823-470e-b46c-d93f3eb8bc1f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:47.570611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d8c5-4823-470e-b46c-d93f3eb8bc1f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:47.572792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 184/362] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:47.577706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff2a2f-1342-446a-b2d3-be017fcd0884 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:47.578169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff2a2f-1342-446a-b2d3-be017fcd0884 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:47.578429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff2a2f-1342-446a-b2d3-be017fcd0884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:47.608549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-52ff2a2f-1342-446a-b2d3-be017fcd0884 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:47.609767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-52ff2a2f-1342-446a-b2d3-be017fcd0884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:47.681034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 179/363] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:47.819020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9939be-6856-4d11-8c6c-3c41a370492d None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:47.819598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9939be-6856-4d11-8c6c-3c41a370492d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:47.820011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9939be-6856-4d11-8c6c-3c41a370492d None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:47.821880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 185/364] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:47.826845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:47.827131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:47.827415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:47.854744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:47.856016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:47.931303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 180/365] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:48.139480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9939be-6856-4d11-8c6c-3c41a370492d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.275845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9939be-6856-4d11-8c6c-3c41a370492d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:48.323101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:48.323735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.324011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.324283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.344491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:48.349392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:48.350309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:48.351083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 186/366] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:48.357662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.384270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.394713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:48.442099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:48.504377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27283-85f1-4265-9180-28ce15c9be48 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:48.573912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:48.574536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.574819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.575092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.575999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:48.576302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:48.578459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cdd63-03a2-42c5-ab65-2f9a1280fb49 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:48.581147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:48.593039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 181/367] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:48.598225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.635270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746b13f-4106-4d49-851f-9ebb02f158c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:48.635906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b13f-4106-4d49-851f-9ebb02f158c1 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.636183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b13f-4106-4d49-851f-9ebb02f158c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.636454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b13f-4106-4d49-851f-9ebb02f158c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.648058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746b13f-4106-4d49-851f-9ebb02f158c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-7746b13f-4106-4d49-851f-9ebb02f158c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:48.653933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:48.654835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 187/368] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:48.660406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a21eb-fe51-47b8-a6f0-9a13da431860 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.661302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a21eb-fe51-47b8-a6f0-9a13da431860 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.661302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a21eb-fe51-47b8-a6f0-9a13da431860 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.661302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 188/369] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:48.666672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a21eb-fe51-47b8-a6f0-9a13da431860 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.722135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:48.744561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464a29-54f7-4200-a1d9-85268a11b4e4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:48.776470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:48.789425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a21eb-fe51-47b8-a6f0-9a13da431860 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:48.797853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:48.799217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.799642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.800060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.816364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:48.818636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:48.828045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:48.828750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.829101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.829443 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.830204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:48.830593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:48.832107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-09d2327f-12aa-4e08-ac17-45db63dc65c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:48.838511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:48.839407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:48.840243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:48.840243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:48.840243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:48.842375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 182/370] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:48.843790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:48.844258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:48.844653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:48.847985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 189/371] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:48.848946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.870026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:48.871220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:48.949856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 183/372] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:48.949856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:48.982633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a5b6-f8cd-4a90-8d95-b9ade1ef137c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.023549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.035707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.036920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.037648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.038128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.039114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:49.039594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.041996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69c76b-4cb2-4b6b-9fad-2d210e4f5a59 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.058239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 190/373] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:49.060347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e11eed-4c4c-4ebf-98ce-f49fa66b4ada None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.060847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e11eed-4c4c-4ebf-98ce-f49fa66b4ada None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.061298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e11eed-4c4c-4ebf-98ce-f49fa66b4ada None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.061572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d15f-df57-47e7-a8ae-046d993e5093 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.063444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 191/374] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:49.065216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e11eed-4c4c-4ebf-98ce-f49fa66b4ada None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.081457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.108911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.109548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.109868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.110563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.122387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.123845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-416a3b8d-f8ff-4627-9fcb-fa1ec326d776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:49.141015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:49.142019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:49.142954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:49.142954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:49.142954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:49.142954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 184/375] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:49.143515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4340a-667e-4bc9-a74d-ed20101590db None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.143581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4340a-667e-4bc9-a74d-ed20101590db None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.143814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4340a-667e-4bc9-a74d-ed20101590db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.162622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ffa4340a-667e-4bc9-a74d-ed20101590db None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:49.163800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ffa4340a-667e-4bc9-a74d-ed20101590db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:49.174399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e11eed-4c4c-4ebf-98ce-f49fa66b4ada None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.210716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.211627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.212617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.212889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.220469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.221956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.233471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 185/376] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:49.234764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24939f64-7c66-4906-b18c-40e1d8d07f92 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.235049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24939f64-7c66-4906-b18c-40e1d8d07f92 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.235321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24939f64-7c66-4906-b18c-40e1d8d07f92 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:49.236338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:49.237227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:49.238156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 192/377] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:49.238796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.241005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 186/378] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:49.241694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24939f64-7c66-4906-b18c-40e1d8d07f92 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.299864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.309860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.342956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d95bab-ad5d-46f9-bb8c-418d1ea1f4d5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.353629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24939f64-7c66-4906-b18c-40e1d8d07f92 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.378359 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.378955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.379245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.379492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.380232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:49.380533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.382096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef29511-68cf-47c7-b096-2b7d1c97da02 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.388103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.388728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.389004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.389608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.395385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 193/379] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:49.401266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.401545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.401664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:49.401891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:49.406502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:49.407355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:49.408167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 187/380] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:49.408876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.422329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:49.423501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:49.497819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 194/381] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:49.502678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.513677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2264d-1266-44c0-8621-cc86169b1d1c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.525162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.550390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.550993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.551264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.551593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.552250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:49.552726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.553996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.568887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.595045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:49.595045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.615229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110542-28f6-4055-be9d-f6f0e7d3d7a7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.653068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.653879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.654273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.654546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.661883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.663321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:49.676420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:49.677501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:49.683303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.698725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc513-63fb-4f8c-8f2d-b28c81ae47fb None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.731278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.731938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.732214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.732493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.733149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:49.733442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.734852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.742626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 189/384] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:49.748170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.778551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.786494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892f7f-cfbb-4a2e-be9f-96ee0d0a3950 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.808700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:49.821244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.822031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.822642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.822642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.832271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:49.838174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:49.839119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:49.839912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 196/385] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:49.840560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.849471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc576-8921-41a5-ba93-80e0bbc66b1d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.882741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.883354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.883795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.884058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.894246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.895679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:49.911166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:49.912174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:49.913003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:49.913003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:49.913003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:49.913003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:49.913412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:49.940798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2775a-05aa-41b3-8fa3-070c65680288 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:49.973657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:49.974185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:49.974465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:49.974727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:49.975442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:49.975743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:49.977195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:49.995037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.013011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd0be1-af33-4172-9c52-eadb1a4db238 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.015983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 197/387] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:50.016820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.046221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.046837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.047110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.047375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.058306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.059618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.059758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:50.074522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:50.075441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:50.076277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:50.076277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.076277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:50.076277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 191/388] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:50.076498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.122969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5cb1d-d59a-4fae-adc2-4e3d54e6af82 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.156021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.156642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.156920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.157192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.167570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.169027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.172976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017162-2f0d-4147-8476-90e474cbe8ce None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:50.184090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:50.185200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:50.186170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:50.186170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.186170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:50.186170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 198/389] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:50.186685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.208370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.208972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.209251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.209522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.210208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:50.210515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.212458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.213779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.221408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 192/390] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:50.222242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.278347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.288251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b514a-cd03-42bd-8f82-f48b4d326789 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.319202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafc9a3-8042-48e9-a40e-41836ccabce1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.322137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.322727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.323001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.323268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.323896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:50.324194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.325543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.337196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 199/391] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:50.341835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.353398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.354048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.354327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.354591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.364747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.366230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:50.380434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:50.386034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:50.387134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:50.387134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.387134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:50.387134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 193/392] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:50.387134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.432306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.439761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f445be-9a62-48cc-99f0-13e67f0d0939 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.473330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.473978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.474419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.474699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.475670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:50.475983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.477376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.483353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe423ec-bd93-40e0-a6c2-abbf9a7592ea None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.488292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 200/393] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:50.489077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.504660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.517472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.518106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.518377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.518646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.519277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:50.519574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.520950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.532737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 194/394] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:50.533456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.588123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b739ec-85af-47b0-9198-843e67b3bcf0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.622591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.623209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.623476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.623753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.632440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75d50c-605f-4e97-b433-f32fe2917839 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.635265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.636724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.641790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:50.651654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:50.652556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:50.653398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:50.653398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:50.653398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:50.653398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 201/395] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:50.653607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.668196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.668818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.669089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.669355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.676028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.677468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:50.688928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:50.689804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:50.690650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 195/396] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:50.691894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.716607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.753429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb5b6-ecd3-4b7f-aa7a-7ac161281c42 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.786590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.787111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.787385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.787652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.788280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:50.788526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4dd5-a062-48fd-a2ed-920a0c2af02b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.788632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.790143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.800890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 202/397] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:50.801654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.826595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.827247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.827529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.827800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.835118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.836546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:50.849239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:50.850283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 196/398] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:50.851144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:50.878770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.906430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51d9c-dca7-4274-bb46-fb6908676645 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.928479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:50.939232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:50.939827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:50.940100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:50.940366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:50.941002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:50.942455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:50.952938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f978abc-4b12-48b4-9bba-7329b55eb897 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:50.963350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 203/399] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:49:50 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:49:50.964239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.009185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.010471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.010764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.011037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.011692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:51.012408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.014770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.036293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 197/400] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:51.036293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.074669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585af49-0199-4719-b66a-9361eec2a3d0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.110278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.110906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.111178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.111449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.112145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:51.112444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.113923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.132144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 204/401] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:51.132995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.154571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.167981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450fac-0fa2-4e96-b408-5fe7a83834a9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.190054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.205273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.205954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.206203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.206472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.213134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.214624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:51.226401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:51.227522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:51.228722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:51.232167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 198/402] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:51.232882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.255496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0607202-ab8b-4394-931f-24aafd305374 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.293267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.294139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.294560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.294976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.296013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:51.296564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.298089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.317872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 205/403] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:51.318681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.339675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab594ab-2baf-4513-a1f0-422eb7d7a0df None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.375926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.376551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.376939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.377215 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.384758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.386472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:51.399772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:51.401285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 05:49:51.402396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:51.405633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 199/404] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:51.406622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.418867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.426978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.432522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405c3f2-c72a-4db0-87d9-38daef53e4bc None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.476695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.478031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.478311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.478697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/6caa2ac059864911ac3d429df74b693e/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.493948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=6caa2ac059864911ac3d429df74b693e, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.495400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.509183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae12b-4aa9-48a0-83d7-1af6a2b57d50 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.509562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 206/405] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:51 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/6caa2ac059864911ac3d429df74b693e/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:51.510506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.578914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.580144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.580626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.581569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.582899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:51.583613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.586121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.611120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 200/406] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:51.611992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.644468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870646c-a5a4-47e3-aaf1-536376bfafb7 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.690031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.692830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.693463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.693713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.694003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.705974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.707657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.717537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:51.727191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:51.729060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:51.730437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:51.730437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:51.730437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:51.731006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 207/407] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:51.731911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.732641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcb718-5369-4a01-bf81-f13df10104de None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.775247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.776801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.777082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.777352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.778115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:51.778417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.779866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.803388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 201/408] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:51.804295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.853087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bb34d-39e8-4dc2-b4b8-2dc7095ca084 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.894340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.894923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.895200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.895471 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/a667b7903d5c484e891e69382f6d20e7/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.912228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=a667b7903d5c484e891e69382f6d20e7, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.914176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:51.920955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40404b-9418-44ee-8338-7bf54a42693a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:51.931049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 208/409] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:51 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/a667b7903d5c484e891e69382f6d20e7/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:51.931649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:51.958197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:51.969475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:51.970132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:51.971237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:51.972908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:51.973591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:51.973932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:51.975320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.007787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 202/410] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:52.014286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:52.033611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:52.108255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d40ff-0d25-4c08-8085-cd6296dabbbb None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:52.146731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:52.147292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:52.147564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:52.147830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:52.159187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:52.160787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.177647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe90d54-8439-4a57-8c0b-8dd84fb749d5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:52.178966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:52.179804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:52.181177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:52.181177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:52.181177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:52.184246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 209/411] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:52.191326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:52.232455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:52.233088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:52.233369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:52.233639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:52.244891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:52.246390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:52.263137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:52.264010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:52.265098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:52.267845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 203/412] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:52.270945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:52.361518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e558da-077e-4545-854c-d03a7bcca96f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:52.363072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:52.372387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:52.429053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:52.429584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:52.429887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:52.430161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:52.430942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:52.431248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:52.432645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.445299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 210/413] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:52.450910 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:52.472383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a22b7-5022-47e2-b8d5-d100ccd50379 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:52.535640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:52.536245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:52.536520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:52.536783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:52.537469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:52.537786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:52.539220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.562065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 204/414] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:52.568028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:52.628736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153827e-bfe9-4523-88cf-78e41be89d69 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:52.698865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:52.699462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:52.699693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:52.699937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:52.707917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:52.709359 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:52.734106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:52.735019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:52.735847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:52.736688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 211/415] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:52.745623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:52.763027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d555c-a6da-4348-a30b-048212425de9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:52.773995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:52.798104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:52.841089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:52.841773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:52.842111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:52.842390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/8203173f183e4494b580181cd3647e85/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:52.871928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=8203173f183e4494b580181cd3647e85, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:52.873470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:52.897700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 205/416] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:52 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/8203173f183e4494b580181cd3647e85/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:52.958101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6dd8-0e18-4e48-afac-4811f09449ef None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:53.022511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:53.023144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:53.023425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:53.023696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:53.024968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:53.025277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:53.026925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2b0e5-ac6c-4d00-a7dc-dd7d875a41f2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:53.045395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 212/417] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:53.051006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:53.204421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06b9cc-d98b-46ad-87fa-6f999b349040 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:53.247457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9c9ca-9182-4b58-928f-6280cbc9fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:53.248452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c9ca-9182-4b58-928f-6280cbc9fbf1 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:53.248924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c9ca-9182-4b58-928f-6280cbc9fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:53.249386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c9ca-9182-4b58-928f-6280cbc9fbf1 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/a57b3ec9b66547c0afce59fe21c5feb4/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:53.267560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9c9ca-9182-4b58-928f-6280cbc9fbf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=a57b3ec9b66547c0afce59fe21c5feb4, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:53.269023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9c9ca-9182-4b58-928f-6280cbc9fbf1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:53.297207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 206/418] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:53 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/a57b3ec9b66547c0afce59fe21c5feb4/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:53.401209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4660da5-5684-410a-9d79-698942edcd08 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:53.401572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4660da5-5684-410a-9d79-698942edcd08 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:53.401789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4660da5-5684-410a-9d79-698942edcd08 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:53.403519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 213/419] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:53.408913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2f2b-9e07-449c-ac4c-d8dcf2663858 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:53.409184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2f2b-9e07-449c-ac4c-d8dcf2663858 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:53.409458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2f2b-9e07-449c-ac4c-d8dcf2663858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:53.424222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:53.436971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d4fc2f2b-9e07-449c-ac4c-d8dcf2663858 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:53.438244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d4fc2f2b-9e07-449c-ac4c-d8dcf2663858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:53.545237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 207/420] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:53.870949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4660da5-5684-410a-9d79-698942edcd08 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:53.974100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:53.994878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0085b1-1397-4b4f-ba9a-aaad0fb9046f None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:53.995388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0085b1-1397-4b4f-ba9a-aaad0fb9046f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:53.995464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0085b1-1397-4b4f-ba9a-aaad0fb9046f None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:53.997020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 208/421] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:54.003042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.003364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.003602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.007357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4660da5-5684-410a-9d79-698942edcd08 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:54.022602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:54.024110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:54.052830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:54.053520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.053815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.054087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.065501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:54.070318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:54.071712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:54.072662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 214/422] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:54.079419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:54.162422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 209/423] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 05:49:54.246698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5a8e-3a83-401c-b88e-6bd7223f81a5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:54.290660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:54.291274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.291553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.291828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.292495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:54.292800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:54.297911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:54.307156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 215/424] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:49:54.312931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:54.381734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:54.418851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1aa5-d38c-4a12-9f09-6ee7206c35cb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:54.473778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:54.474467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.474747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.475018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.491418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:54.493385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-eea29585-09bd-4321-a2f3-7b917e46c7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:54.511448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:54.512399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:54.513622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:54.513622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:54.513622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:54.513622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 210/425] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:54.520028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:54.524021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:54.581156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5320-901e-4781-844c-0f07c8ca8f0c None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.581472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5320-901e-4781-844c-0f07c8ca8f0c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.581701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5320-901e-4781-844c-0f07c8ca8f0c None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.583068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 211/426] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:49:54.604246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.604528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.604786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.641451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:54.643103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:54.650070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9bfe6-b3e8-43d3-a629-47edf3ab9ead None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:54.690807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:54.691887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.692363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.692819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.693722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:54.694275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:54.695883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:54.709995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 216/427] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:54.711115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:54.738664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 212/428] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:54.739839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:54.782954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:54.824321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a669e5-0a36-4171-9e53-3d79fafcf504 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:54.833385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:54.864279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:54.865230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.865699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.866346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.887711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:54.893763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:54.894612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:54.895408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:54.899439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 217/429] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:54.907248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:54.929763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32a7ff-4254-44ff-b982-b02423ded949 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:54.973000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:54.973614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:54.973922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:54.974193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:54.991850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:54.994038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:55.013958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:55.015549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:49:55.016430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:55.017861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 213/430] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:49:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:55.018878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.044144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242c110-08ba-4d34-83ea-dc4819d22433 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.070250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.088416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.089300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.089409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.089627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.090321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:55.090612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.091971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.101824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 218/431] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:55.102915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.143929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b5bb-d26e-42b8-b4dd-ce3ff5d370f6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.154314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.182342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.183129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.183540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.183908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.194988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:55.200493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:55.201477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:55.202320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 214/432] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:55.202966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.214797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc9a33-a435-4cb6-ac1d-2e0a8687c739 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.251849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.252751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.253201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.253644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.254825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:55.255678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.257299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.279326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 219/433] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:55.280407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.309472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd37d9-2dac-474f-bc00-1cb803fa47c6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.333245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.348188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.348898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.349518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.349875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.364754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.366350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:55.386431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:55.387352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:55.388187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:55.388187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:55.388187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:55.389816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 215/434] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:55.390849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.402564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8617f-dd89-4c4a-8284-aa4d367decd1 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.424705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.443843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.444757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.445256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.445803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.446902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:55.447419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.449128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.460275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 220/435] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:55.461727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.534741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa006f-c223-4df3-838a-8b761ec9b309 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.571825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.572465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.572750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.573020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.584070 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.584396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47a31-50a3-435d-9191-248aff2dea9b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.585520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.593392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:55.600972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:55.601947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:55.603360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:55.603360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:55.603360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:55.603360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 216/436] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:55.603570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.627632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.628212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.628487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.628750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.629384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:55.629681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.631067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b930-4fcb-4546-abfd-69810694781f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.648212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 221/437] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:55.650385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f57f5-1e27-458d-b59a-3a9c724b9dc9 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.650665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f57f5-1e27-458d-b59a-3a9c724b9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.650941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f57f5-1e27-458d-b59a-3a9c724b9dc9 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.652163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 222/438] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:55.652853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f57f5-1e27-458d-b59a-3a9c724b9dc9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.685866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.721482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d2a9-ef3b-4113-b868-9b2c8fc9db66 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.756485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.757119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.757396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.757674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.763721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f57f5-1e27-458d-b59a-3a9c724b9dc9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.770062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.771545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:55.786535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:55.787608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:55.788648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:55.788648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:55.788648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:55.792396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 217/439] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:55.793242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.802015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.802954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.802954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.803236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.803757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:55.804052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.806040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd57c96-bbdf-4b99-bea8-8efc71200633 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.818371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 223/440] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:55.819557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.819838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.820108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.843716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:55.845455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:55.869135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.904321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bd3a2-d95d-4be7-b086-b8c8524df0c8 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:55.925779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 224/441] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:55.925779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:55.936230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:55.946528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:55.947159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:55.947519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:55.947792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:55.957938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:55.959686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:55.980313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:55.981271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:55.982222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 218/442] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:55.982786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.053257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e77e-db4b-45cf-8e02-00ba5f8c3a8d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.089716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.090661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.091093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.091548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.092326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:56.092768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.094333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.107127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 225/443] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:56.108291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.121439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed7d9-d04f-4b3d-8eca-675e461cbff8 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.127304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.156908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.157523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.157832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.158105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.164600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.166624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-d0aa29e9-d50a-4a29-9600-7e9b84239c70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:56.177699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:56.178583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:56.179437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 219/444] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:56.180511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354dc84-1f8d-4c62-8630-80f0b57b41e9 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.180511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354dc84-1f8d-4c62-8630-80f0b57b41e9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.180511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354dc84-1f8d-4c62-8630-80f0b57b41e9 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.181905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 220/445] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:56.182443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354dc84-1f8d-4c62-8630-80f0b57b41e9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.224960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5f5a0-c174-45c2-ae77-a592abab0045 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.231038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.258359 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.259498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.259819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.260097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.260819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:56.261124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.262570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.279861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:56.280648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.287895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354dc84-1f8d-4c62-8630-80f0b57b41e9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.320727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.321815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.322116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.322367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.329536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.331015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-edd8f8ad-7e36-4b8e-9a20-18d75022cee3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:56.341883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:56.342975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:56.343860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 221/447] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:56.344414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.344414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.344530 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.357778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.362787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:56.363973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:56.383931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fb04c-7b60-4958-ae2f-6cf2ce81f6f4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.418146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.418743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.419023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.419293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.419983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:56.420270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.421683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.431428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 222/448] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:56.432400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.439181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 227/449] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:56.439181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.472672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.541760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24ee8f-efe6-4053-bf3f-b68f0e247e8d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.546421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199fb9-0c73-4cc7-be17-2d49b8d2f4be None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.577726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.578315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.578592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.578862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.584027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.584794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.585068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.585587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.589131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.590030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:56.594933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:56.595790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 223/450] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:56.598594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.671640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.673166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.693548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.701147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087d69-2d3c-4120-997b-bd46b6f1434c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.734556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.735144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.735418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.735685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.736394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:56.736698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.738175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.755096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 224/451] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:56.755859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.775849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 228/452] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:56.776688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.808165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:56.862203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12727575-ba7d-4bc9-a1cc-f9757edb89cc None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.871844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379f1b-4f8c-4857-994b-23d17aed065c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:56.896266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.896924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.897203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.897478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/bc7643a92cc44ea8b718a4f8532105ee/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.907517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:56.908110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:56.908422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:56.908654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:56.909295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:56.909587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.910976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.912629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=bc7643a92cc44ea8b718a4f8532105ee, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:56.914071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:56.920620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 229/453] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:56.921961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.928362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 225/454] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:49:56 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/bc7643a92cc44ea8b718a4f8532105ee/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:49:56.929164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:56.932687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.044818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.046557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abcf8-76d4-4be0-b8cd-5c70f20be197 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.052647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8de0a-49c8-4197-a174-3b383b010492 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.087343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.088066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.088436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.088628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.091503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.092149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.093324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.093596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.106774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:49:57.112092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:57.113021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:57.113844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 230/455] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:57.115045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.171131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.172639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.174630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.223983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7638-b71d-4523-b472-47e518ecbf88 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.259611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.260237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.260514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.260778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.271997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.273432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.283304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 226/456] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:57.283304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:57.292521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:57.293425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:57.294295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:57.294295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.294295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:57.294295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 231/457] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:57.294517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.307395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.395860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda492c-98a4-49de-9487-2181cf75cfb5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.397870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.402967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67af9f-a31c-45d4-9c40-5692d4cf0a15 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.433551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.434201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.434478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.434748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.439616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.440218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.440492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.440759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.441420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:57.441716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.443212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.445106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.447383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.452523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 232/458] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:57.453160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:57.464908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:57.466387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:57.467323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:57.467323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.467323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:57.468117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 227/459] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:57.468771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.531325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.565452 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10944-4274-49f9-8b32-0726ab15d9a9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.575725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b17610-b35a-4672-8659-94b2ec6b545b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.599117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.599758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.600013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.600308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.610991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.612437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.614111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.615322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.615858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.616411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.617427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:57.618009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.619837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:57.627065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:57.627946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:57.628776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:57.628776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.628776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:57.628776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 233/460] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:57.628992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.639137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 228/461] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:57.640490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.659197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.741860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fd12-bd7c-46cc-b81a-bfb366f73e84 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.749881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934d16f-42d5-48ce-bd2a-35f33f37a636 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.765663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.779746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.780771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.781107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.781381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.788642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.789246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.789524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.790427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.791069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:57.791743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.793136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.793368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.794969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.804372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 229/462] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:57.804372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:57.816723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:57.817727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:57.818887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:57.818887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:57.818887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:57.818887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 234/463] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:57.819616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:57.895345 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:57.931258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1d8d-e003-4c15-b1d5-1b0b897bda09 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.948362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed26da-2332-4570-83dd-7610ac8b0c51 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:57.984327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.984925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.985201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.985469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:57.986175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:57.986478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:57.987852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:57.994692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:57.995322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:57.995595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:57.995859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.001409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 230/464] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.002508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.004413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.006034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:58.019728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:58.020643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 235/465] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:58.021467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.060666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.116145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0888-e3c2-4dc1-8c03-a7d6064592a4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.132449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ce68-4c55-4dfa-b0d6-071df2ce5e52 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.157197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.157771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.158058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.158331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.160402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.167847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.169310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.171633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.172303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.172525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.172798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.173440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:58.173754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.175154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:58.183100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:58.184309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:58.185214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 231/466] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:58.185844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.190383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 236/467] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.191217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.293137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.293368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8368-23ad-4d8c-844f-df56e8286362 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.300463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c640-d0d6-492c-aa45-310930b4445b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.327632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.328252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.328525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.328793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.334389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.334992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.335270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.335510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.335621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.336210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:58.336518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.337454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.338473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:58.349900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:58.350736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:58.351610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 232/468] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:58.352065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.355384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 237/469] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.356263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.410547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.461296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e51b54-5c5c-482d-8969-bde4d92da1e7 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.464203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710871-4d9f-4358-9678-1f282b5777a7 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.496809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.497415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.497697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.498003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.498736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:58.499044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.500053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.500479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.500671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.500945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.501210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.509824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.512146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.518710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 233/470] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.520044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:49:58.524594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:58.525497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:58.526411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 238/471] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:58.526977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.543499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.626891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513ce67-cb36-462b-8e2b-6f75b3dee381 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.632724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc997-3142-4697-88e1-d3f1cd4dc034 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.641259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.664738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.665618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.666031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.666402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.667261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=6caa2ac059864911ac3d429df74b693e) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:58.667631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.669165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.669274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.669841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.670125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.670398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.671085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:58.671399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.672815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.676292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 234/472] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/role_assignments?user.id=6caa2ac059864911ac3d429df74b693e&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.677340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.698967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 239/473] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.699985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.797006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.836888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d465ae-0f77-4eb5-bebf-99d644f86d10 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.855294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5478c5-6f91-443a-87d8-607821acd378 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:58.878127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.879165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.879645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.880133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.881192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:58.881896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.884205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:58.894287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628d01-6cf5-421f-af75-cd5f95b45970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:58.895276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628d01-6cf5-421f-af75-cd5f95b45970 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:58.895685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628d01-6cf5-421f-af75-cd5f95b45970 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:58.896106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628d01-6cf5-421f-af75-cd5f95b45970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:58.910622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 240/474] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:58.911689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:58.948944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:58.980344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628d01-6cf5-421f-af75-cd5f95b45970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:58.982380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628d01-6cf5-421f-af75-cd5f95b45970 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.032620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedb30-031c-4c0f-8065-9df67dc933a3 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.070048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.075444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.077135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.077792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.078384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.079440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=a667b7903d5c484e891e69382f6d20e7) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:59.079844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.081374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.090079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 241/475] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/role_assignments?user.id=a667b7903d5c484e891e69382f6d20e7&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:59.091200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.119594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 235/476] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:59.121355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d821c-b2d5-493d-ace9-f6d4f1c084f2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.121644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d821c-b2d5-493d-ace9-f6d4f1c084f2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.121962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d821c-b2d5-493d-ace9-f6d4f1c084f2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.123485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 236/477] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:49:59.126780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d821c-b2d5-493d-ace9-f6d4f1c084f2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.225369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9892a7-783a-4366-87a2-067a6428d9d7 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.266136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.269966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.270592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.270873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.271466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.282838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d821c-b2d5-493d-ace9-f6d4f1c084f2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.324716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.325264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.325534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.325830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.337392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.338892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.345092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.354430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.355907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-dabe8742-5ff2-44ae-89b8-5f09b88047f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:59.356075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:59.356929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:59.357818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:59.357818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:59.357818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:59.357818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 237/478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:59.358694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.358970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.359259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.379767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:49:59.380966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:49:59.469010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 242/479] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:49:59.469919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.476981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 238/480] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:49:59.477978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.546475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.596998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabe6b-f28b-4cc3-8907-70e3a9a08039 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.643008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.643642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.643918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.644194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.663752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.668589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.673994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdee3d-7d40-4aec-afb6-0d9f140f3155 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.678182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.713869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.714542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.714825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.715096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.715746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:49:59.715859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:59.716802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:49:59.717646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:49:59.717646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:49:59.717646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:49:59.717832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.717900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 239/481] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:49:59.721922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.734817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.740011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 243/482] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:59.742360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.850595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a3861-2d27-49b0-ade9-1fc66788f98e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.888312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.889088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.889360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.890016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.896975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.898442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.899269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f91f-6fd8-4800-9876-86b52a25b356 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:49:59.910127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:49:59.912562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:49:59.913963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:49:59.915742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:49:59.918667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 244/483] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:49:59.919715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:49:59.937726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:49:59.938398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:49:59.938621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:49:59.938882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:49:59.939514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:49:59.939811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:49:59.940642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:49:59.941583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:49:59.955075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 240/484] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:49:59.955983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.046686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf63152-f65d-4cb5-a927-9e80b3f752f6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.057525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068d61-ddb8-4750-8cd6-7135eb46c6c3 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.086312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.088135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.088565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.089274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.092962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.093637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.093999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.094335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.095117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:00.095465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.096942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.101851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:00.108504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:00.109681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:50:00.110685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:00.111597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 241/485] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:00.112468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.119216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 245/486] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:00.121005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.150155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:00.226728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:00.226928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692878-fbfa-4d8a-9e34-1a18b6156d01 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.254113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11b73-f278-45af-9451-813a4c60fd14 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.263879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.264831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.265173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.265770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.272778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.275332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:00.287034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:00.288048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:00.289093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:00.290602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 242/487] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:00.291594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.303555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.304177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.304454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.304722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.306121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=8203173f183e4494b580181cd3647e85) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:00.306432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.308330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.322162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 246/488] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/role_assignments?user.id=8203173f183e4494b580181cd3647e85&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:00.323360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.456591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae01be-fd93-4c44-ac29-061b885ed8b8 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.462460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:00.491603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.492335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.492682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.493573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.494575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:00.494961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.495166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901554a-d903-4b5b-aba8-9041fd1a35f0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.496827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.506659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 243/489] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:00.519359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.554535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.555167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.555972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.556243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.557268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:00.557683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.559251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.569694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:00.574479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 247/490] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:00.580658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.644287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018ad6-ce56-4a0d-b713-adc752e31ba9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.681718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.682397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.682678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.682948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.692426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14764-ef84-434e-b9f3-fdf28f67cf25 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.693676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.695281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:00.713862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:00.714969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:00.716213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:00.716213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:00.716213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:00.716213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 244/491] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:00.721322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:00.725442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:00.734395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.735304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.735755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.736321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.737242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=a57b3ec9b66547c0afce59fe21c5feb4) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:00.737761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.739480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.746411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 248/492] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/role_assignments?user.id=a57b3ec9b66547c0afce59fe21c5feb4&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:00.859882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc817793-5df4-43aa-915e-b27d8f5ff770 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:00.907986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:00.908602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:00.908872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:00.909146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:00.909830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:00.910138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:00.911536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a79f96-e655-4bd1-891c-2d2b0600e825 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:00.926013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 245/493] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:00.931390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:01.017635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:01.057772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b95ac-b2cd-41f3-87f4-958cf0918325 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:01.091976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef68cd-f482-44cc-b720-21608aa335a1 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.092353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef68cd-f482-44cc-b720-21608aa335a1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.092741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef68cd-f482-44cc-b720-21608aa335a1 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.093705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:01.094191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.094191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.094349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.094890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 246/494] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:01.099940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.100327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.100725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.103044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:01.104490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:01.116398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:01.117522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:50:01.119502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:01.125930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 249/495] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:01.127854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:01.139090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:01.140889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:01.247972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:01.262845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 247/496] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:01.280159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60dbb-8206-49a5-8ab2-65d7c6650184 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:01.320051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:01.323306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:01.323988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.324269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.324593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.325672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:01.326337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:01.328195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:01.355625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 250/497] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 05:50:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:01.361283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:01.474798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48921-786a-4dc7-82f4-86918a283f9f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:01.511942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659536-4984-42a6-bb5b-dc8c4f299f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:01.512472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659536-4984-42a6-bb5b-dc8c4f299f81 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.512752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659536-4984-42a6-bb5b-dc8c4f299f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.513023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659536-4984-42a6-bb5b-dc8c4f299f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.585975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:01.598975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659536-4984-42a6-bb5b-dc8c4f299f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:01.600501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659536-4984-42a6-bb5b-dc8c4f299f81 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:01.624493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:01.728935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e554a44-7fba-4317-bddc-57b8a7316798 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:01.752403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 248/498] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 05:50:01.754056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca59ca-1276-4c8d-bf5d-d3c176289571 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.754561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca59ca-1276-4c8d-bf5d-d3c176289571 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.755014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca59ca-1276-4c8d-bf5d-d3c176289571 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.756692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 249/499] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:01.761572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca59ca-1276-4c8d-bf5d-d3c176289571 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:01.767805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618e63-29e1-4203-bb02-ec489985dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:01.768374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618e63-29e1-4203-bb02-ec489985dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.768656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618e63-29e1-4203-bb02-ec489985dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.768917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618e63-29e1-4203-bb02-ec489985dbd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.779965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c618e63-29e1-4203-bb02-ec489985dbd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-3c618e63-29e1-4203-bb02-ec489985dbd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:01.784746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:01.785663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:01.786789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:01.790643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:01.791904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.792195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.792464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.811318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:01.812535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:01.853774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:01.894461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:01.895602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 252/501] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:01.896684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:01.904666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca59ca-1276-4c8d-bf5d-d3c176289571 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:01.950118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:01.950751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:01.951024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:01.951291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:01.975802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:01.983782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:02.006052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:02.007477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:02.008346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:02.008346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:02.008346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:02.008346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 250/502] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:02.010383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86545ec4-109f-43a1-9161-acc59c7060f9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.019123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.075520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.076143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.076421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.076694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.077381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:02.077686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.079107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.103686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 253/503] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:02.105014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.142096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.210411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76559d-db08-42a8-b5d9-d96833ad8e68 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.234471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304a2f3-ba41-4a57-bcf7-60fb00076e17 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.246917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.247549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.247827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.248099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.259842 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.261302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.274909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.275452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.275733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.276013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.276656 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:02.276959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:02.278004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:02.278908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:02.279805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:02.279805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:02.279805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:02.279974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.283613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 254/504] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:02.284448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.292325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 251/505] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:02.293225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.304255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.390542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.408365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb410-efb0-454e-a5d6-65597d3f48e9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.426496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e778c-2571-425a-8fa6-1d393f58ad61 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.451176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.452012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.452440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.452879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.465509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.467529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.470009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.470693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.471043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.471393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.472111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:02.472485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.473956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:02.484058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:02.485240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:02.486444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:02.486444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:02.486444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:02.492114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 252/506] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:02.492114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.493386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:02.495765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.559174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.595759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6990d-b391-4ef8-9736-620a90b1b4ce None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.606244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d286-89b0-4563-97b5-6e55dac94238 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.632476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.633217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.633779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.634149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.641584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.643210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.643689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.644564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.645062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.645520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.654260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:02.655781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:02.656671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:02.657564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:02.658674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.662055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.662638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 253/508] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:02.663796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:02.673660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:02.674770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:02.675712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:02.679968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 256/509] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:02.681355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.781771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044e30-3146-425f-b634-8e7de26d3629 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.800147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfd2ec-0f89-4d66-b2f2-191ced560183 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.817694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.823619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.824610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.825187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.825662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.826545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:02.827311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.828996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.837183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:02.837995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:02.838271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:02.838542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:02.839237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:02.839986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:02.841202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:02.845728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 254/510] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:02.846839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.859550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 257/511] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:02.859550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:02.930970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:02.966018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fb4e0-bec7-44a1-98cd-96309999b8ea None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:02.974643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21743d-7096-4460-930d-5b47352bec2b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:03.010336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.011367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.011852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.012348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.013246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:03.013704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.015277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.015776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.016131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.016520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.016884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.017638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.019330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.042270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 255/512] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 05:50:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:03.043546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.045506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 258/513] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:50:02 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:03.046769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.096690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:03.161715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a510f0b-a675-4345-821d-927a377bc3b1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:03.183124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b92af-48ca-4c6d-92f4-ba424da8bc30 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:03.200816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:03.204566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.205468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.205950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.206418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.207376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=bc7643a92cc44ea8b718a4f8532105ee) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:03.207840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.210934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55718-15ff-4430-9024-36aba29bbccd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.225942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 256/514] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:03 2022] GET /identity/v3/role_assignments?user.id=bc7643a92cc44ea8b718a4f8532105ee&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:03.227125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.228074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.228347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954574-590a-4e17-8d1e-371ef8c78415 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.228566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.228938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.229086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954574-590a-4e17-8d1e-371ef8c78415 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.229483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954574-590a-4e17-8d1e-371ef8c78415 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.231431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 257/515] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:03.236944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.237464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.238029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.242760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.244937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:03.260979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:03.262275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:03.263352 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:03.263352 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:03.263352 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:03.266754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 259/516] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:03.271105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.275607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:03.277079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:03.379179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 258/517] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:03.411286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dea51-7a94-45ee-90f7-0eab6c389ff5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:03.451472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.452240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.452620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.452987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.453732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:03.454156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.455611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a310dc-5e99-4616-b89a-d97586f61459 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.468673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 260/518] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:03.474247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.522936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:03.586051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ee36-0041-48c8-890e-979e088e2bd9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:03.612741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c8ae0-e187-4203-b1f7-aca761554877 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.613048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c8ae0-e187-4203-b1f7-aca761554877 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.613294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c8ae0-e187-4203-b1f7-aca761554877 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.614761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 261/519] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:03.622607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.623023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022971-5f1a-4b47-8017-14970500531c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.623223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.623343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022971-5f1a-4b47-8017-14970500531c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.623581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.623701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022971-5f1a-4b47-8017-14970500531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.623888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.631248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.632651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:03.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:03.656043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:03.656932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:03.661078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 259/520] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:03.662095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.666768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-44022971-5f1a-4b47-8017-14970500531c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:03.668026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-44022971-5f1a-4b47-8017-14970500531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:03.704644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:03.756367 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 262/521] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:03.757335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022971-5f1a-4b47-8017-14970500531c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.779695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:03.785296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab7aa-e758-47d5-8fba-1c28c6c0c4a6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:03.874044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:03.874660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:03.874935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:03.875202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:03.875892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:03.876194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:03.877649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:03.892972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 260/522] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:03.903273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:03.950172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022971-5f1a-4b47-8017-14970500531c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.022142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.022783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.023060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.023334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.023916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.026378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:04.047717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:04.048773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:04.049611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 263/523] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Oct 20 05:50:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:04.058984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:04.084555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:04.100832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d9f3-3cf8-4c8e-a812-57e5996bb29a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.145286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.146545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.147017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.147499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/6caa2ac059864911ac3d429df74b693e/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.150233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=6caa2ac059864911ac3d429df74b693e, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.151968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.168996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 261/524] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:03 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/6caa2ac059864911ac3d429df74b693e/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:50:04.170242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:04.192486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:04.216684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd51da-e915-4b74-89fe-3983bf515042 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.276973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.278001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.278788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.279256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.280108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:04.280621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.282240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.288759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 264/525] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 05:50:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:04.294816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:04.384173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe570f-3d0c-4d12-afde-0802a3d80faa None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.439053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:04.461847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.462433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40553d-b4b0-4865-8979-0e3c633ff721 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.463357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.463958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.464426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] PATH_INFO: `/v3/services/network` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.465260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.466861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:04.480549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:04.482099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:04.482941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:04.485726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 262/526] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:04 2022] GET /identity/v3/services/network => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:04.496038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:04.505358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.506043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.506327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.506602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.507246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:04.507555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.509799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.517373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 265/527] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 05:50:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:04.617368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:04.643499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7567ed-0e08-4566-95ff-62d5c0cb5806 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.696609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.697322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.697420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.697667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.698327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] RBAC: Adding query filter params (name=network) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:04.698625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.700012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad24c9-f41f-4e7e-aaf0-1f97c6733204 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.710060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 263/528] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:04.715453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:04.867420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5af323-1b22-445d-969a-4903bfbfe594 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:04.905449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:04.906089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:04.906366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:04.906640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:04.907268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:04.907572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:04.908940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662595-c1ee-43fe-8ff2-c0d29bb74af8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:04.913967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 266/529] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:05.561380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7053ac-53ce-4e1c-bb02-1b0500138b75 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:05.562003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7053ac-53ce-4e1c-bb02-1b0500138b75 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:05.562003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7053ac-53ce-4e1c-bb02-1b0500138b75 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:05.563520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 264/530] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:05.568710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6aef-8e99-4b26-8406-afb48ae06ccf None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:05.569096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6aef-8e99-4b26-8406-afb48ae06ccf None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:05.569278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6aef-8e99-4b26-8406-afb48ae06ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:05.588911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-afac6aef-8e99-4b26-8406-afb48ae06ccf None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:05.590117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-afac6aef-8e99-4b26-8406-afb48ae06ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:05.597728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:05.669666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 267/531] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:05.971802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30071-a13c-4d1b-820c-4d00cd1bb161 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:05.971991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30071-a13c-4d1b-820c-4d00cd1bb161 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:05.972263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30071-a13c-4d1b-820c-4d00cd1bb161 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:05.974051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 265/532] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:05.982549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:05.982549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:05.982549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:05.983498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30071-a13c-4d1b-820c-4d00cd1bb161 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.006951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:06.008125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:06.103819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30071-a13c-4d1b-820c-4d00cd1bb161 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:06.140096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 268/533] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:06.162078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:06.162719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:06.163000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:06.163271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:06.176668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:06.181822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:06.182784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:06.183631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:06.189066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.262430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:06.294158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7774a01-6b87-4fda-a81f-a9670d4e95ee None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:06.328915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:06.329592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:06.329902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:06.330176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:06.330844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:06.331146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:06.332564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:06.341813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 269/535] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:06.347220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.358113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:06.457069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8c469-691c-4dee-8db8-bf107cdaeb58 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:06.493811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:06.494542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:06.494822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:06.495091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:06.505495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:06.506986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:06.522886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:06.523810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:06.525302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:06.525302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:06.525302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:06.525302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 267/536] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:06.532533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.583933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.652848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:06.700998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca291-2865-4e2d-8060-c13ef2b971b5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:06.725432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42fda-fd55-48ee-a9d1-f6db23930fbd None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:06.740405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:06.741038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:06.741316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:06.741591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:06.753858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:06.762151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:06.763152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:06.763980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 268/537] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:06.771700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.798156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:06.798695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:06.798968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:06.799344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:06.800093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:06.800400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:06.801777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:06.803401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:06.829822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 270/538] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:06.839074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:06.920035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8ce9-5460-478b-a977-8c142ddb00c1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:06.958172 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:06.989875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:06.990507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:06.990785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:06.991056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:06.991752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:06.992059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:06.994130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.016651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 269/539] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:07.023125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.064525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95741af1-1458-4058-a31e-01fe73604a19 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.123629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.124294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.124571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.124844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.132505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.134313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-0e06a369-15c5-4c01-8987-01b1b6d2b591 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:07.146622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:07.147579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:07.148490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 271/540] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:50:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:07.150114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb790d-5baa-4bff-bad4-f837b2dbba9b None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.150114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb790d-5baa-4bff-bad4-f837b2dbba9b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.152871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb790d-5baa-4bff-bad4-f837b2dbba9b None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.155912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 272/541] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:07.156713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb790d-5baa-4bff-bad4-f837b2dbba9b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.173970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeaf7a-e234-4430-a3aa-9846ca3bb613 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.209969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.210605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.210886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.211165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.216598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:07.223187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.224763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-cd5a7c44-73ca-405e-bcea-4d391c5446a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:07.240325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:07.242510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 270/542] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.245132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.269440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:07.270291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb790d-5baa-4bff-bad4-f837b2dbba9b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.270775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:07.300002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:07.309060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.309688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.310017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.310288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.311039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:07.311343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.312802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.333831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 273/543] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:07.334624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.353758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 271/544] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:07.354973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.465711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f80a3f-c9a8-4c76-8703-68881f0fb89b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.480746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1cc4c-636d-4a75-8a20-c50b4b13569e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.495947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:07.503409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.504049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.504329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.504643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.515343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.516794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.521695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.522747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.523225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.523773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.525311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:07.525810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.528117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63058adf-6408-4f3d-af5b-5734beeca909 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f8e21868-a3b6-4730-9508-9a7046407450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:07.532359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:07.533290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 272/545] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2054fee-514d-493f-9d0b-6f8fa1c8444f None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2054fee-514d-493f-9d0b-6f8fa1c8444f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2054fee-514d-493f-9d0b-6f8fa1c8444f None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 273/546] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:07.538919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84e38-5efd-4531-ada0-6191dee109b5 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.539434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84e38-5efd-4531-ada0-6191dee109b5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.539434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84e38-5efd-4531-ada0-6191dee109b5 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.541000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 274/547] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:07.545286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84e38-5efd-4531-ada0-6191dee109b5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.546465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 274/548] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:07.547223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c170-6a84-4088-b794-5c197bdb6989 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.547333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c170-6a84-4088-b794-5c197bdb6989 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.547896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c170-6a84-4088-b794-5c197bdb6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.561839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:07.566142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-09b5c170-6a84-4088-b794-5c197bdb6989 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:07.567313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-09b5c170-6a84-4088-b794-5c197bdb6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:07.638183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 275/549] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:07.640551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.641040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.641650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.657441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84e38-5efd-4531-ada0-6191dee109b5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.664086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:07.666565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:07.691623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.692357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.692706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.693048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.693795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:07.694106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.695467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.710194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 275/550] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:07.710194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.737529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 276/551] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 05:50:07.739432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.775460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:07.798434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:07.827262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2feb0c-3b60-4455-a60b-54013a9449b0 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.862131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c725-049c-49b3-a31c-dbc90bee9ebd None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:07.871683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.872460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.872781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.873154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.884055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:07.885581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:07.902150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:07.903193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:50:07.904117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:07.905515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:07.906400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:07.906868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:07.907325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:07.908267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 276/552] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:07.909097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:07.919000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:07.924317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:07.925230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:07.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:07.932534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 277/553] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:07.932534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.022237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21ec69-c0d9-4c50-ac3c-8af5b77e8662 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.030712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.040775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9842-1a7e-4fd9-93d6-5162349ac41d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.056049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.056669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.056942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.057209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.059050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.064323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.066016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.075052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.075655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.075933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.076207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.076934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:08.077242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:08.077334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:08.083153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:08.084353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 277/554] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:08.084965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.085109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.096488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 278/555] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 05:50:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:08.097305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.180913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfde8-8cd6-436f-834c-300ed8232224 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.197401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52a07d-9cde-440b-8785-70d6e2f8e8bb None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.214208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.214809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.215086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.215356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.215994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.217353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.231642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.232251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.232533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.233012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.233115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 278/556] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:08 2022] POST /identity/v3/services => generated 240 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:08.233474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:08.233707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.233833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.235240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.254473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 279/557] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:08.254473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.271522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.300174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.362002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4b136-5ea1-45a4-b330-5b226a8d2d40 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.368372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98147d-bb1b-4aab-8f92-7d3d38128bcf None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.401448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.402096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.402384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.402659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.403315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.404695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.406482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.407294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.407390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.407621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.409075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:08.409075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.410057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.421280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 279/558] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:08 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:08.422313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.424609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 280/559] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:08.425519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.524143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.564130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855341-0853-429c-ad90-9a4dd1ad993a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.565223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981796a-5989-44c3-8358-45351b3c5927 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.573368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.612171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.612810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.614351 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.614351 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.615584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.616642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.616642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.616839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.626026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.627116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.629856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.631313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:08.645781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:08.646794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:08.647668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:08.647668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:08.647668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:08.650355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 281/560] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:08.650962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:08.651842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:08.652729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:08.652729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:08.652729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:08.652729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 280/561] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:08.652948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.658822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.769287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34b30-274a-41f2-9e1f-afd4d0b06883 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.771246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b752-4ec4-4fe3-9237-38c2ed8c8ab6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:08.800141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.810623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.811399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.811919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.812299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.813051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:08.813455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.813635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:08.814503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:08.814919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:08.815239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.815473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/3f8de808ec41406bbde9e63a6a212f7e/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:08.829333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 281/562] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:08.830671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:08.833649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=3f8de808ec41406bbde9e63a6a212f7e, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:08.835281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:08.851617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 282/563] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:08 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/3f8de808ec41406bbde9e63a6a212f7e/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:50:08.852244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:08.853713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.006146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74692db-dcd0-444c-858f-0232e9260f3f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.050921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3be8-3e36-4fa1-b0e8-a3903935a3dd None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.063969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.064612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.064892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.065162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.073356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.074851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:09.088189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:09.089161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:09.090133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 283/564] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:09.095000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.095611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.096229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.096508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.096784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.097428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:09.097728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.099118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.112513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 282/565] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:09.118099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.146011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:09.230299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:09.230494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97add894-8e78-40c1-a25b-6856aa9411a9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.272629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27026-c0bf-4590-8424-1b587b3925a6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.305107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.306329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.306656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.306878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.307621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:09.307930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.309376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.342236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 284/566] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 05:50:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:09.343108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.343806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.344090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.344366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.347567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.352135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.354321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:09.368183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:09.369409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:09.370686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:09.373223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 283/567] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:09.379188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.516583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:09.526881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31772a0e-4b9e-402b-a60b-91c5eeed15ce None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.562908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.563749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.564195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.564613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.599874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a13b2-bf3e-435c-b601-3344ac3ffeba None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.636932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.638679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.695748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.696889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.697174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.697503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.698407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:09.698556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.699961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.718095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:09.735671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 284/568] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:09.736594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:09.743728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.752732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 285/569] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 05:50:09.757960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.861082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d36dec-26a8-4921-b9b4-051263275056 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:09.897369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:09.898398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:09.898955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:09.899470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:09.910134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:09.911800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:09.927901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:09.928941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:09.929848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:09.929848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:09.929848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:09.932183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 286/570] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:09.937077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:09.949303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6996-f238-454b-b2d3-1d7952e5f7f3 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:10.020900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:10.021565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.021866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.022141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/bc7643a92cc44ea8b718a4f8532105ee/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.026424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=bc7643a92cc44ea8b718a4f8532105ee, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:10.026949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:10.027854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:10.053547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 285/571] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:09 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/bc7643a92cc44ea8b718a4f8532105ee/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:50:10.121315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e16b-2684-4adb-a8d3-5130cc502ff2 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:10.183603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:10.184230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.184509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.184784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.185440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:10.185765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:10.187182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:10.212136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 287/572] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:10.217672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:10.320105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:10.377009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840d9bc-f1ee-47d8-bf36-b03dc7319226 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:10.415548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:10.416179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.416456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.416727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.423733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:10.425204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:10.437270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:10.438242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:10.439122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 286/573] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:10.444001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:10.553428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53517-867f-41c0-9111-ee6bab3e0d0d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:10.560855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:10.589249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:10.589949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.590229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.590557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.591252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:10.591593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:10.593048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbf5b0-eede-405c-b265-f0c9207d68d2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:10.606090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 288/574] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:10.614919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:10.744183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ce4-8126-482a-9755-fd5961537852 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:10.767387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:10.807344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:10.807982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.808265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.809798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.809798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=6caa2ac059864911ac3d429df74b693e) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:10.809798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:10.811060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70f3ea-4fa2-4705-9f10-aee7e952122b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:10.817735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 287/575] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:10 2022] GET /identity/v3/role_assignments?user.id=6caa2ac059864911ac3d429df74b693e&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:10.902952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9dde-8c18-43c7-a79a-91110e709c05 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.903464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9dde-8c18-43c7-a79a-91110e709c05 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.903572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9dde-8c18-43c7-a79a-91110e709c05 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.905166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 289/576] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:10.910893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.911516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.911989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.943717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:10.944248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18140847-56cf-4725-8e66-f9ed5a267655 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.944539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18140847-56cf-4725-8e66-f9ed5a267655 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.944815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18140847-56cf-4725-8e66-f9ed5a267655 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.944919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:10.946649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 290/577] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:10.952536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00bba-4919-4ac6-a11b-b896e50bcd45 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:10.953145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00bba-4919-4ac6-a11b-b896e50bcd45 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:10.953631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00bba-4919-4ac6-a11b-b896e50bcd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:10.990204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1df00bba-4919-4ac6-a11b-b896e50bcd45 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:10.991806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1df00bba-4919-4ac6-a11b-b896e50bcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:11.073290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 288/578] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:11.100610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 291/579] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:11.353050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:11.472845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b5f1-a399-4235-8866-46d0064ba637 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:11.473241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b5f1-a399-4235-8866-46d0064ba637 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:11.473421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b5f1-a399-4235-8866-46d0064ba637 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:11.475151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 292/580] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:11.485242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:11.485511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:11.485796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:11.487555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6a09-59a1-44c6-a98a-e3e96f0463f0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:11.502778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:11.507074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:11.510083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:11.526601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:11.527218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:11.527504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:11.527775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:11.528745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:11.530433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:11.541684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:11.542780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:11.543634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 289/581] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Oct 20 05:50:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:11.544684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:11.599233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 293/582] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:11.600189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:11.641160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:11.708867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e35cc4-e66b-49f1-bc28-a5272d3b179c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:11.759232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3428170-1d86-4490-86e3-d67d89cbcf04 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:11.781797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:11.782455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:11.782710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:11.782985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:11.783569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:11.785033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:11.799452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:11.800500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:11.801381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:11.802149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 290/583] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:11 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:11.807911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:11.828725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:11.829345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:11.829626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:11.829927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:11.830566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:11.830923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:11.834021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:11.842882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 294/584] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 05:50:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:11.848948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:11.893224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:11.965391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef125-2c80-436c-a16e-8d1e3a132ec6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:11.980884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:11.997091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f306-8cd1-4910-9b4b-d66853190cac None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.014169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.015141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.015423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.015700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.016331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] RBAC: Adding query filter params (name=network) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:12.016890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.018684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.024515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 291/585] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:12.025894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.037329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.038256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.038729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.039244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.040945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:12.041445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.043028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.049387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 295/586] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 05:50:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.050445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.156505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82450a07-8817-4eb5-a494-5f8ae1149b08 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.159927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:12.186154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fc987-c411-4fd5-8609-02e4e8705229 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.210664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.211824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.212203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.212478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.222524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.223398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.223869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.224357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.225171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] RBAC: Adding query filter params (type=network) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:12.225284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:12.226071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.228159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:12.231981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:12.232894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:50:12.233724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:12.236316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 296/588] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.237313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.237420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 292/588] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:12.242144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.260900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:12.359214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc6f4-f36c-4670-b3e3-0481e5ebab4a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.362581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24074a2b-a50b-4056-b0f6-4eb01e387043 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.398663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.400269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.400897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.401449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.402370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] RBAC: Adding query filter params (interface=public, service_id=3f6d7d464a7842f7803db5e7435888bb, region_id=RegionOne) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:12.402909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.403263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.403934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.404277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.404611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.405222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.405337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:12.405696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.407212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.415915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 297/589] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/endpoints?service_id=3f6d7d464a7842f7803db5e7435888bb&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.417045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.422442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 293/590] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.426860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.457776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:12.524460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:12.538957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1acaa9-a6dd-40bf-8466-bdcf10f8dc60 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.547675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a7bd5-7b09-4a0a-9b2d-cf2ea92180dd None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.574853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38748-8591-4173-b963-8a790267398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.575550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38748-8591-4173-b963-8a790267398a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.575909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38748-8591-4173-b963-8a790267398a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.576480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38748-8591-4173-b963-8a790267398a None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.576954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c38748-8591-4173-b963-8a790267398a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.578420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c38748-8591-4173-b963-8a790267398a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.584387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 294/591] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.585472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38748-8591-4173-b963-8a790267398a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.589568 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.591656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.592237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.592699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.593679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] RBAC: Adding query filter params (interface=public, service_id=14005544cfbf4871a775d33036d6ceb3, region_id=RegionOne) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:12.594238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.595881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.604434 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/endpoints?service_id=14005544cfbf4871a775d33036d6ceb3&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.613784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.746825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:12.757855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38748-8591-4173-b963-8a790267398a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.796042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc828-3560-42a8-8342-8104ccee8d05 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:12.800615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.801252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.801531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.802932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.816201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.818083 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-1c8bb00b-d8e8-4ccc-b638-c2f84d1c2c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:12.833296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:12.834384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:12.835641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:12.835641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:12.835641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:12.835641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:12.835887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843b41-f3ee-4eeb-ad96-3f2785428f8d None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.836262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843b41-f3ee-4eeb-ad96-3f2785428f8d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.837023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843b41-f3ee-4eeb-ad96-3f2785428f8d None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.838208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:12.838346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.838612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.838721 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 296/594] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:12.838876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.839541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:12.841029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:12.843973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:12.844259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:12.844535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:12.847041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 299/595] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:12.847907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:12.864814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:12.866065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:12.878887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:12.956080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 297/596] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:12.988119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f093c96-f796-4184-b58b-1bae58c2dc8e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.024670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.025195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.025470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.025755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.026401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:13.026700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:13.028068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:13.042398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 300/597] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:13.047744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.149852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:13.183148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f2a7b-ee8f-43ef-a6b1-fb9d1874b4a6 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.218800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.219434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.219709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.219978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.227265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:13.228809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:13.240653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:13.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:13.243311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 298/598] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:13.248245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.250044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.338904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:13.391801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a718-6424-40b7-ba2d-50d33c7dd482 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.406606 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade4b04-4043-43d3-bc53-9e0bbbe09d09 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.467900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.468329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:13.468507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.468786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.469057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.469841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:13.470280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:13.474917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:13.479928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.480565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.480838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.481103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.502701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:13.508047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:13.509544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:13.510976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 299/599] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:13.512984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 301/600] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:13.515671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.518521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.648518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667a2c-7772-46e1-8ed0-3099ef8777e4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.663695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d772bf0-87ca-41b6-9955-e01c24a22dc4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.676109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:13.686472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6189b3-a9eb-48a9-80c5-08bd30f7839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.687305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6189b3-a9eb-48a9-80c5-08bd30f7839d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.687652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6189b3-a9eb-48a9-80c5-08bd30f7839d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.688031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6189b3-a9eb-48a9-80c5-08bd30f7839d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.711859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.713142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.713426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.714008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.714692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:13.715260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:13.717344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdaf5c-46a1-407b-9a16-493b1e0c6f21 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:13.734427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 300/601] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:13.735886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313aea1-90b8-4d42-8465-cad137c889d3 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.736641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313aea1-90b8-4d42-8465-cad137c889d3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.736923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313aea1-90b8-4d42-8465-cad137c889d3 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.738624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 301/602] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:13.739365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313aea1-90b8-4d42-8465-cad137c889d3 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.779385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6189b3-a9eb-48a9-80c5-08bd30f7839d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:13.781874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6189b3-a9eb-48a9-80c5-08bd30f7839d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:13.803748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:13.866176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313aea1-90b8-4d42-8465-cad137c889d3 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:13.911445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 302/603] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 05:50:13.912795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.912966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:13.913127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.913344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.913663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:13.914036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:13.914432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:13.928082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:13.929971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:13.933721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:13.934939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:13.948589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:13.950602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:13.952793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:13.952793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:13.952793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:13.952793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 302/604] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:13.952793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:13.966983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.024989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 303/605] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:14.027462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.131710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abfc16-4754-4d7b-95a5-c881dce1b52e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.148575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.203922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.204474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.204752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.205021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.230073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.231556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.239383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6079f9-1483-4b51-bbca-c92d164bcefe None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:14.262886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:14.263900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:14.265106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:14.265106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:14.265106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:14.265106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 303/606] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:14.271347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.298734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.299344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.299624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.299892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.300538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:14.300840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.302258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.331289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 304/607] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:14.333197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.354424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.417274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319856-0252-406d-86c0-11f3818cd7dc None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.441813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267607f5-2767-447b-be1a-89449d56d2fd None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.463660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.464812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.465300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.466026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.467574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:14.468062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.470638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.477483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.478224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.478565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.478926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.479619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.481078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.486569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 304/608] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:14.487680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:14.490904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:14.491885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:14.493414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:14.497588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 305/609] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:14.498599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.515663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.600562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e391b55-e5b1-4439-9169-380be58467a9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.605474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.631696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0455bb-5ffb-4725-bead-6862b3fdfae6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.638827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.639459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.639993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.640268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.647938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.650244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:14.662577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:14.663524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 05:50:14.664788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:14.668736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 305/610] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:14.669545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.677834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.678805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.679711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.680807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.690257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.692335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:14.706263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:14.707192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:14.708085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 306/611] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:14.708608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.772840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.803437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a34cb9-0b5f-4a19-b68e-d5896dbcd01b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.844385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa29b0a-546c-4811-bd99-54599b5b951b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:14.860786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.861420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.861673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.861972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.862611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:14.862917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.865038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.876557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 306/612] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:14.877436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:14.911900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:14.912914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:14.914386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:14.915596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:14.917710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:14.920233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:14.921933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:14.944414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:14.965838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 307/613] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:14.965838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:15.058416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83f5bd-47c3-4e1a-b7b4-7aab15e7ddba None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:15.120961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:15.121593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.121901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.122182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.122886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:15.123192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:15.124656 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:15.147732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 307/614] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:15.147732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:15.152565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:15.158390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444e21b-b1b5-488e-bcca-6d4c6e18d529 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:15.203934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:15.204548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.204832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.205106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.205760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:15.208244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:15.209617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d92aa-8104-44c5-abb1-7024746f7ce4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:15.215890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 308/615] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:15.227880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb71fe-fba1-4958-b5f5-d42069d733db None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.228226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb71fe-fba1-4958-b5f5-d42069d733db None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.228438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb71fe-fba1-4958-b5f5-d42069d733db None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.233899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 309/616] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:15.233899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb71fe-fba1-4958-b5f5-d42069d733db None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:15.299384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dda09-1c8d-4caa-8b48-8cd79255f4fa None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:15.355204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:15.392872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:15.393558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.393888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.394243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.405974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb71fe-fba1-4958-b5f5-d42069d733db None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:15.451322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:15.451937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.452216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.452486 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.453219 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=3f8de808ec41406bbde9e63a6a212f7e) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:15.453529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:15.455062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a82a8-56f7-483f-8b22-7bb5c1fd847c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:15.461861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 310/617] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:15 2022] GET /identity/v3/role_assignments?user.id=3f8de808ec41406bbde9e63a6a212f7e&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:15.463158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6340b-ceae-48b2-9a45-23eea28b9a1e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.463457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6340b-ceae-48b2-9a45-23eea28b9a1e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.463703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6340b-ceae-48b2-9a45-23eea28b9a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.473351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:15.475298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:15.479848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:15.487160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-cba6340b-ceae-48b2-9a45-23eea28b9a1e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:15.488802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cba6340b-ceae-48b2-9a45-23eea28b9a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:15.578822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 311/618] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:15.581021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d10d3-f6fd-4e48-9361-975a5e692509 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.581309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d10d3-f6fd-4e48-9361-975a5e692509 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.581581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d10d3-f6fd-4e48-9361-975a5e692509 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.588029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 312/619] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:15.589533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.589838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.590108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.602357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 308/620] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:50:15.607833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:15.611476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:15.612670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:15.691955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:15.713097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 313/621] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:15.741442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d455472-7324-488e-a9e7-0aa96921398f None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:15.743723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:15.783471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:15.784102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:15.784382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:15.784654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:15.796089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:15.797536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:15.813531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:15.814600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:15.815501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:15.815501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:15.815501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:15.815501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 309/622] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:15.822468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:15.931643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18305c-a33f-4003-8077-7e2e2b49afc4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:15.946392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.007865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.008538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.008815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.009085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.009731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.010061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.011426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.025348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 314/623] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.026231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.085430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:16.113932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee3fac-28c3-4922-b887-e52fa6eb0abf None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.151603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edd913-e68e-4848-8cf2-7c9eb2cedb70 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.158762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.159982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.160336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.160673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.161317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.163295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:16.176570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:16.177666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:16.178564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 310/624] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Oct 20 05:50:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:16.179360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.196087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.197425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.197917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.198347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] PATH_INFO: `/v3/services/network` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.199085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.201187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.205038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:16.212396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:16.213423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 05:50:16.214306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:16.217812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 315/625] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:16.218847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.306378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80170-e490-443f-a680-0e7e9b0864b4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.348813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f575-b27a-4417-bf61-05b06562c853 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.353275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.354234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.354720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.355194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.360775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:16.365999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.367950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:16.383760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:16.384689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:16.385596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:16.386718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.387324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.387599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.387866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.388487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.388893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.393992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.394440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 311/626] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:16.395774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.398207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 316/627] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.399315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.492179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:16.520664 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6db38-59a4-4329-bd9e-5b6f2099e07f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.521783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf3bc-9f05-4703-bbed-68a37a4bb7d4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.561938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.562540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.562869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.563138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.563922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.564223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.565626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.569726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.570596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.571716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.572211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.573552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] RBAC: Adding query filter params (name=network) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.574096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.576395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.583328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 317/628] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.583328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.591417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 312/629] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.592337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.626141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:16.706408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b83e6-3d5f-45ae-a71c-6f721925a27e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.716073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8d86-f0f9-4357-ba41-1c57444a88ec None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.743333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.743844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.744116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.744405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.745159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=bc7643a92cc44ea8b718a4f8532105ee) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.745517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.747482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.762054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 313/630] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/role_assignments?user.id=bc7643a92cc44ea8b718a4f8532105ee&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.762054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.776980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.777601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.777900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.778167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.778802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.779102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.780497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.781998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:16.796048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 318/631] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.806953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:16.906057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa86d5e-f49e-4238-8418-d67788c6e79d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:16.944216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:16.944937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:16.945295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:16.945833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:16.946616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] RBAC: Adding query filter params (type=network) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:16.947179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:16.949397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:16.958192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 314/632] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:16.966164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:17.018148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:17.024658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd5178-8feb-495a-ab61-d77678bb79be None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:17.044407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:17.067285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d3ba-e7f2-4df0-9868-bf88921b3798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:17.068258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d3ba-e7f2-4df0-9868-bf88921b3798 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:17.068763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d3ba-e7f2-4df0-9868-bf88921b3798 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:17.069264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d3ba-e7f2-4df0-9868-bf88921b3798 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:17.070438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54d3ba-e7f2-4df0-9868-bf88921b3798 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:17.072884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54d3ba-e7f2-4df0-9868-bf88921b3798 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:17.080187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd1bbd-412b-49e7-84a3-c6668169e56e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:17.103886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 319/633] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:17.129784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82618e1-27dd-40cb-b68c-be1fe8cc4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:17.130516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82618e1-27dd-40cb-b68c-be1fe8cc4a93 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:17.130798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82618e1-27dd-40cb-b68c-be1fe8cc4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:17.131072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82618e1-27dd-40cb-b68c-be1fe8cc4a93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:17.131761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82618e1-27dd-40cb-b68c-be1fe8cc4a93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:17.133171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82618e1-27dd-40cb-b68c-be1fe8cc4a93 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:17.160935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 315/634] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:17.563482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231876e3-01b3-47e1-991e-49f457e5e466 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:17.564021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231876e3-01b3-47e1-991e-49f457e5e466 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:17.564021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231876e3-01b3-47e1-991e-49f457e5e466 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:17.565532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 320/635] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:17.572002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71ac4-abac-4d91-b207-067486486774 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:17.572002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71ac4-abac-4d91-b207-067486486774 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:17.572002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71ac4-abac-4d91-b207-067486486774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:17.591262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-51d71ac4-abac-4d91-b207-067486486774 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:17.592753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-51d71ac4-abac-4d91-b207-067486486774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:17.677844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 316/636] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:17.949135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231876e3-01b3-47e1-991e-49f457e5e466 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:18.053600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231876e3-01b3-47e1-991e-49f457e5e466 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:18.090091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabb396-433a-4d70-a879-b7168ac23347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:18.090721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabb396-433a-4d70-a879-b7168ac23347 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:18.090995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabb396-433a-4d70-a879-b7168ac23347 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:18.091261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabb396-433a-4d70-a879-b7168ac23347 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:18.092016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabb396-433a-4d70-a879-b7168ac23347 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:18.093413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabb396-433a-4d70-a879-b7168ac23347 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:18.117902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 321/637] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:17 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:18.193515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952bfb-a02f-4d22-abdf-6e4133a54e65 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:18.194636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952bfb-a02f-4d22-abdf-6e4133a54e65 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:18.195118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952bfb-a02f-4d22-abdf-6e4133a54e65 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:18.197855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 317/638] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:18.203463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:18.204065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:18.204588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:18.224722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:18.226294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:18.237693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:18.316396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 322/639] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:18 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:18.592206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952bfb-a02f-4d22-abdf-6e4133a54e65 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:18.648749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:18.703053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952bfb-a02f-4d22-abdf-6e4133a54e65 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:18.738880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:18.739518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:18.739798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:18.740073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:18.750751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:18.755585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:18.756507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:18.757591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 318/640] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:50:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:18.765341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:18.867142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e96a33-ee19-4a2c-b694-15e715a7c8f5 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:18.904514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:18.905511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:18.906010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:18.906473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:18.907323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:18.907831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:18.909389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:18.923651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 323/641] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Oct 20 05:50:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:18.925251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.034841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975624b-769c-4f87-ba66-ac505ce9173e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.044496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.071866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.072622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.072905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.073181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.084957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.086517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3035e19b-a98c-404d-813f-cba4c836c69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:19.101940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:19.103026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:19.103928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:19.103928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:19.103928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:19.106135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 319/642] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:19.111833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.115080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.223562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83396baf-39ba-4690-901c-4309e0e59b0f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.254089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b614b3-0fe5-4030-86a5-a44ef91edcb3 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.255033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b614b3-0fe5-4030-86a5-a44ef91edcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.255532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b614b3-0fe5-4030-86a5-a44ef91edcb3 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.257348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 320/643] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:19.261477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.261477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.261477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.261477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.261972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:19.261972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.262716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:19.263635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.264130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.264600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.280417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 324/644] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:19.281819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.285036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:19.286556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:19.348611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.365841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 321/645] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:19.395211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275fdd9-9b33-4d49-acd1-7549e7bf6a67 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.432959 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.433588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.433898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.434167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.441683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.443146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-9a4cba0b-3271-41ec-9079-56c8416fa130 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:19.455216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:19.456183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:19.457151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:19.460965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 325/646] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:19.462512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.490322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feaa74-51d5-4c5a-9170-4a7cad309604 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.490617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feaa74-51d5-4c5a-9170-4a7cad309604 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.490774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feaa74-51d5-4c5a-9170-4a7cad309604 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.492531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 326/647] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:19.498550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.498800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.499074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.518751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:19.520060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:19.558920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.569676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4a37-75c0-4077-b50b-1ced4a1f1a04 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.594982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 327/648] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:19.605591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.606230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.606505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.606775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.607499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:19.607800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.609262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:19.629255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 322/649] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:19.634918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.663643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.689873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.739883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8b3c6-69e5-4423-a450-4e0718f3e1cb None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.778433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.779050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.779293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.779505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.782134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a7a21-09da-4b7b-b9e2-b97b7bd7b6b3 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.793353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.795922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:19.815514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:19.816608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:19.817504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:19.817504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:19.817504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:19.819840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 328/650] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:19.825548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.830484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.831130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.831410 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.831685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.832271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.833641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:19.848447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:19.849450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:19.850324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:19.853818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 323/651] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:19.857630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:19.876935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.946742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd2f9-17d3-4648-a8c4-0ca868f5303c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.950489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:19.977657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4ff54-2498-4f96-9ae7-3861007575bd None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:19.992915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:19.993523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:19.993819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:19.994087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:19.994726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:19.995020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:19.996391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.007889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 329/652] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:20.009015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.015471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.016086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.016368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.016641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.017273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:20.017576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.018991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.029502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 324/653] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:20.030456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.110133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:20.117833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e42a5c-a921-443f-9350-f28172e19da4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.135047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfcecc-2d51-41d9-bcc7-5e3b5efc39d7 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.154822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.155458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.155737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.156010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.156591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.157983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:20.167031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:20.168087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:20.168958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 330/654] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:20.170348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.172368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.173002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.173276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.173547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.180782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.182293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:20.193891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:20.194783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 325/655] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:20.196861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.206805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:20.287467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd79c-a3fe-4548-b570-75c9a8967263 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.306710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af68ca-dfc9-4618-b552-834eab589e9c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.328945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.329550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.329866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.330140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.330773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:20.331080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.332625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.338047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 331/656] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:20.338947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.349503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.350485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.350966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.351413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.352766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:20.353348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.355011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.358029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:20.366017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 326/657] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:20.368178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.452511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:20.463322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347436f-5437-4eac-8b3f-0dd548ddba63 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.486643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8178c-e0fe-455c-a570-88eb3ac59046 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.504408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.505129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.505403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.505819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.506525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:20.506827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.508376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5a63f-221a-4bb5-ac8c-e12e41ce1dbe None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.521575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 332/658] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:20.528117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.528365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca82e9f-26b1-4b1d-aa0a-eeb3ba363fdf None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.528616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca82e9f-26b1-4b1d-aa0a-eeb3ba363fdf None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.528736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.528891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca82e9f-26b1-4b1d-aa0a-eeb3ba363fdf None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.528986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.529250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.534067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:20.534067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.534290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 333/659] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:20.534290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca82e9f-26b1-4b1d-aa0a-eeb3ba363fdf None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:20.534454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb666b-c6a5-45ef-b5f3-9f0e0f99ffdc None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.538295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 327/660] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:20.540234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.540853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.540853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.563047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:20.564275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:20.647197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:20.660679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 328/661] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:20 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:20.675424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca82e9f-26b1-4b1d-aa0a-eeb3ba363fdf None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:20.716252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:20.716908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:20.717182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:20.717451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/3f8de808ec41406bbde9e63a6a212f7e/roles/e0d18d67ed6f4c189ed341da24855ad3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:20.719775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=3f8de808ec41406bbde9e63a6a212f7e, role_id=e0d18d67ed6f4c189ed341da24855ad3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:20.721277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:20.738222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 334/662] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:20 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/3f8de808ec41406bbde9e63a6a212f7e/roles/e0d18d67ed6f4c189ed341da24855ad3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:50:20.937527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:21.041096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47de69-fb1c-4b18-9028-edafeeb0a6f5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:21.077125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:21.077766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:21.078045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:21.078311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:21.078894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:21.080244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:21.089419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:21.090430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:21.091394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 329/663] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 05:50:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:21.096398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:21.112279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:21.209799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e875b1-a410-4a84-9d68-6c878711b9c6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:21.246364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:21.246974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:21.247247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:21.247511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:21.248142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:21.248439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:21.249804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:21.255050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 335/664] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:21.261109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:21.325960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:21.370499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d61b-cf3d-44ed-bf03-42e9c8943b20 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:21.405116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:21.405722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:21.406027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:21.406303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:21.406928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:21.407230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:21.408595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:21.417940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 330/665] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:21.419926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:21.499891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:21.527745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4f4f1-777b-4324-a545-86dcb383183a None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:21.563663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:21.564264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:21.564537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:21.564808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:21.565508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] RBAC: Adding query filter params (interface=public, service_id=3dc9959c4eec4d30838704a052f7c631, region_id=RegionOne) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:21.565840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:21.567258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366599-2be4-4b0a-b101-ba7b086ec48a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:21.572832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 336/666] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:21 2022] GET /identity/v3/endpoints?service_id=3dc9959c4eec4d30838704a052f7c631&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:21.578153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:21.685472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ae9e7-20a3-4d47-88cf-b211ae52c3a8 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:21.708989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:21.720879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396fa32-fa37-4983-8c41-f22a5a00cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:21.721492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fa32-fa37-4983-8c41-f22a5a00cb1d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:21.721791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fa32-fa37-4983-8c41-f22a5a00cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:21.722065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fa32-fa37-4983-8c41-f22a5a00cb1d None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:21.722673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396fa32-fa37-4983-8c41-f22a5a00cb1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:21.724039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396fa32-fa37-4983-8c41-f22a5a00cb1d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:21.730373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 331/667] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:21 2022] GET /identity/v3/services => generated 1029 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:50:22.610035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d4c5b-4b38-4e63-a732-8878c816acb7 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:22.610579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d4c5b-4b38-4e63-a732-8878c816acb7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:22.610579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d4c5b-4b38-4e63-a732-8878c816acb7 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:22.612279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 337/668] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:22.618750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7ba3-873d-495b-a115-4668323bd6c0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:22.619796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7ba3-873d-495b-a115-4668323bd6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:22.620916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7ba3-873d-495b-a115-4668323bd6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:22.640863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-888e7ba3-873d-495b-a115-4668323bd6c0 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:22.642467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-888e7ba3-873d-495b-a115-4668323bd6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:22.719491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 332/669] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:22.821886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aae89-2b2e-410a-9d63-f263bbdce4ac None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:22.822237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aae89-2b2e-410a-9d63-f263bbdce4ac None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:22.822470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aae89-2b2e-410a-9d63-f263bbdce4ac None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:22.824070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 338/670] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:22.829482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:22.829805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:22.830075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:22.848813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:22.850033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:22.930619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 333/671] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:22.999981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bdf4e-9e44-469f-a033-9504c01a01cc None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.000263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bdf4e-9e44-469f-a033-9504c01a01cc None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.000539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bdf4e-9e44-469f-a033-9504c01a01cc None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.002164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 339/672] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:23.007165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:23.017707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.017707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.017707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.035832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:23.037390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:23.060214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:23.124917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9438-f33d-4eae-a7b3-2ab7c42c7b72 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:23.125458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 340/673] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:23.156663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:23.157270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.157549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.157841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.158493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:23.159853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:23.177637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 334/674] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:23 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:23.223612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:23.302649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:23.338039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daebe3-b6d4-45aa-9213-0ec81a99fe11 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:23.379508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:23.380112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.380384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.380650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.381291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:23.382673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:23.400095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 341/675] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:23 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:23.418739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:23.534575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8d60-b5e8-4ad3-8975-3f4199f2976c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:23.542678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:23.584524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:23.585165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.585444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.585716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.597433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:23.602830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:23.603786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:23.604649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 335/676] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:50:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:23.609903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:23.717877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d992-72ab-44c8-b18f-782b505092b4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:23.744610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:23.755176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:23.755985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.756272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.756548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.757219 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:23.757523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:23.759109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b25e8-ab6e-4dfc-b814-2d79460690eb None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:23.769350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 342/677] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Oct 20 05:50:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:23.775513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:23.882963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fafaf-0ea5-43db-bdb6-b24ef1bb33a4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:23.919233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:23.919859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.920134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.920403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.931819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:23.933264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-41318fc7-d73e-4032-8e84-5e9f6f5c734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:23.948208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:23.949283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:23.950183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:23.950183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:23.950183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:23.950363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f24d60-3b3d-4a3c-ba35-136458ae072b None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.950744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f24d60-3b3d-4a3c-ba35-136458ae072b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.950909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f24d60-3b3d-4a3c-ba35-136458ae072b None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.952341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 343/679] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:23.952452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 336/679] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:23.955283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f24d60-3b3d-4a3c-ba35-136458ae072b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:23.957471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:23.957767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:23.958047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:23.979786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:23.980977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:23.991710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.064372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 337/680] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:24.082751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f24d60-3b3d-4a3c-ba35-136458ae072b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.118095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.119105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.119575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.120093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.120916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:24.121431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.123044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.135700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 344/681] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:24.141794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.248353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd70c04-7a62-47f3-8742-e3380f372e7d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.283251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.284116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.284534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.284965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.292457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.294115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:24.306303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:24.307418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 05:50:24.308574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:24.315076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:24.316538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.354619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.358760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.372461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.429420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce6bb-bf35-462d-ba62-f1b955ede445 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.472304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aadb1-d076-49c5-ae9c-0f559cef543e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.477982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.478798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.479226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.479698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.481056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:24.481513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.483489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.506717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 345/683] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:24.512531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.514801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.515849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.516296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.516712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.517546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.519261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:24.529333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:24.530374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 05:50:24.531301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:24.538712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 339/684] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:24.539933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.610234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.620843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea799b9-7035-4251-85a5-3c9075b27723 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.629528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.648193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6329d-8e0f-4bc1-8450-cce18ec6c4c5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.659294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.659899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.660171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.660448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.686182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.687110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.687590 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.688155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.688981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:24.689511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.691153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.696873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 340/685] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:24.702644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.730942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.732373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.809627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8cf70-363b-423f-a0bc-a61279f22dff None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.839069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 346/686] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 05:50:24.840256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.841941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.847722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.848576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:24.848822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.849299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.849809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.851588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:24.852764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:24.854486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:24.864835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 341/687] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:24.866117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:24.946424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71481d0-20a2-448e-aa2d-f61be5ce0c3c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.983411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4fe24-f258-4eb3-8b22-bd4d5a55b956 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:24.983983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:24.984620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:24.984895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:24.985163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:24.999999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:25.001439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:25.016481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:25.017451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:25.018495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:25.018495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:25.018495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:25.018495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 347/688] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:25.023144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:25.028832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:25.029711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.030124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.030490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.031265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:25.032813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:25.073798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 342/689] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:25.106667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:25.156825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0a873-9470-40eb-aeee-644e9001ad6e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:25.202577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:25.203450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.203879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.204295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.205085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:25.205548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:25.207143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:25.221726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 348/690] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:25.231111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:25.292738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:25.346235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dfafd-5d44-47f8-a306-945f34f43bff None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:25.385086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:25.386278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.386778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.387271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.395299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:25.397131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-eff6e9d2-f78c-4864-8208-f3a08231a2ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:25.411158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:25.412118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:25.413020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:25.415876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 343/691] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:25.421719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:25.518617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782feeb-7bcb-4e46-8690-ce3643a1dc9a None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.518805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782feeb-7bcb-4e46-8690-ce3643a1dc9a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.519135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782feeb-7bcb-4e46-8690-ce3643a1dc9a None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.520620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 344/692] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:25.525626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654ba4-a596-486b-ae27-875acd3de357 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.525941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654ba4-a596-486b-ae27-875acd3de357 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.526214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654ba4-a596-486b-ae27-875acd3de357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.531912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2979c-ab17-4a38-8760-06e13aaa8107 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:25.548828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:25.549256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ee654ba4-a596-486b-ae27-875acd3de357 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:25.551921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ee654ba4-a596-486b-ae27-875acd3de357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:25.572207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:25.572916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.573253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.573591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.574375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:25.574761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:25.576258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:25.590943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 349/693] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:25.596465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:25.647519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 345/694] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:25.710348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5f40-f658-444e-bd4b-0731c3069b8c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:25.744642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:25.745299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.745525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.745783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.746509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] RBAC: Adding query filter params (role.id=e0d18d67ed6f4c189ed341da24855ad3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=3f8de808ec41406bbde9e63a6a212f7e) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:25.746813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:25.748308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa584-f1c2-4fe4-bddf-499a6cff6d9d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:25.761320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 350/695] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:25 2022] GET /identity/v3/role_assignments?user.id=3f8de808ec41406bbde9e63a6a212f7e&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=e0d18d67ed6f4c189ed341da24855ad3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:25.763230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa0ce-d1da-4e34-b465-0603e21cf684 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.763624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa0ce-d1da-4e34-b465-0603e21cf684 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.764001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa0ce-d1da-4e34-b465-0603e21cf684 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.766118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 346/696] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:25.771979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:25.772182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:25.772456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:25.793166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:25.794410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:25.827948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:25.870798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 351/697] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:25.928358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa0ce-d1da-4e34-b465-0603e21cf684 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:25.984572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.047665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa0ce-d1da-4e34-b465-0603e21cf684 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.083180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.083798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.084071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.084340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.084970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.087019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:26.096217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:26.097205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:26.098473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 347/698] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:26.103833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.145722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.226046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34150a3e-4c53-41a2-a323-c53841f492a4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.257605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ee138-71c3-42c4-85d3-4a96d2db8fa4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.266813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.275083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.276163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.276441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.276709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.277336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:26.277793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.279562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.285994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 352/699] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:26.292082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.306232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.307362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.307845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.308704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.309819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.311845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:26.323789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:26.324806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:26.325761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:26.326522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.329421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 348/700] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:26.336189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.402923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864e83-f8e9-4ab4-a4e9-73cfb5e08872 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.444599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.445223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.446030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.446365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.447000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:26.447297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.448652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.459893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 353/701] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:26.461095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.466779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c958-f15e-4561-9fe4-3c41660c4d9e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.501904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.502512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.502787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.503055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.503680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:26.503976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.505340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.510857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 349/702] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:26.516468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.557150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.573962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.580679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c545-e088-47f0-96fc-2256339857ae None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.616843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.618383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.619020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.619562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.620485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] RBAC: Adding query filter params (interface=public, service_id=0121cc07522c438f9f214a56eb24023a, region_id=RegionOne) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:26.621010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.622665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.628632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 354/703] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/endpoints?service_id=0121cc07522c438f9f214a56eb24023a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:26.634091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.635108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ceb4-7890-4459-8068-02dfcd2a6e95 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.670545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.671196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.671475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.671740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.672806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:26.672806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.674099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.684541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 350/704] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:26.685872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.746764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbf152-8464-4b6f-a9a3-5fc6aaf78c57 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.783456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.784479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.784965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.785440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.786349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.788009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.789031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.795331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513376b-912b-4ac8-8e19-65e54dce53ce None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:26.796093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 355/705] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 05:50:26.849074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:26.850079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:26.850655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:26.851131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:26.852261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] RBAC: Adding query filter params (interface=public, service_id=150733fec14f4978bb809b4f5dcb218d, region_id=RegionOne) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:26.852794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:26.854445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abe312-e96d-4318-9605-234f6502cd2a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:26.863698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 351/706] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/endpoints?service_id=150733fec14f4978bb809b4f5dcb218d&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:26.870258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:26.901523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:26.989489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c97d-1afa-432d-8c27-74b7024ae644 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:27.026890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175938b5-e9d2-4468-857d-99fd5fc0738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:27.027498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175938b5-e9d2-4468-857d-99fd5fc0738f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:27.027776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175938b5-e9d2-4468-857d-99fd5fc0738f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:27.028050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175938b5-e9d2-4468-857d-99fd5fc0738f None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:27.028657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175938b5-e9d2-4468-857d-99fd5fc0738f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:27.030058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175938b5-e9d2-4468-857d-99fd5fc0738f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:27.036723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 356/707] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:26 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:50:27.424019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ba277-8bd8-4058-a795-06953fd029c5 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:27.424570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ba277-8bd8-4058-a795-06953fd029c5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:27.424570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ba277-8bd8-4058-a795-06953fd029c5 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:27.426156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 352/708] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:27.431913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:27.432201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:27.432474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:27.450889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:27.452065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:27.523343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 357/709] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:27.794065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ba277-8bd8-4058-a795-06953fd029c5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:27.901083 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ba277-8bd8-4058-a795-06953fd029c5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:27.937381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:27.938032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:27.938305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:27.938574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:27.939146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:27.940498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-d57bbae1-a6c1-48f5-9d67-ebdde11c002a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:27.950162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:27.951159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:27.952005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 353/710] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:27.957364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:27.977707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:28.071636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acead76-3d73-4c28-b74a-90b323da92c7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:28.107497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26437216-88e1-484b-ab1e-a607f76a31ac None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.107838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26437216-88e1-484b-ab1e-a607f76a31ac None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.108029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26437216-88e1-484b-ab1e-a607f76a31ac None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.110198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 354/711] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:28.112224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:28.113111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.113603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.114175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.115006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:28.115233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.115515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.115785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.116131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:28.118221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:28.124118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 358/712] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:28.130687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:28.138250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:28.140145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:28.172713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:28.221781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:28.237880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 355/713] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:28.248502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584524a-a05f-439e-b7a3-373fd3c58f1e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:28.284751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:28.285655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.286110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.286526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.287295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:28.287833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:28.289390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:28.294669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 359/714] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:28.511617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:28.617895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc8e5-e419-4ddd-abd8-013b0bbfd870 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:28.655756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:28.656392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.656675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.656950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.657534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:28.658947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:28.668497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:28.669536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:28.670597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 356/715] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Oct 20 05:50:28 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:28.678005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:28.785311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98217a0-93b9-4131-a15f-1bad20eb2504 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:28.822153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:28.822800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.823082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.823347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.823969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] RBAC: Adding query filter params (name=image) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:28.824266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:28.825725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246af2-9f79-40d7-9f80-b6a69b7ead52 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:28.831054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 360/716] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:28.837381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:28.861144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:28.955669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc4de-738a-4f13-85c6-759002c795c5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:28.996241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:28.996857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:28.997138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:28.997416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:28.998096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] RBAC: Adding query filter params (type=image) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:28.998398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:29.001079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2fd16-76cb-4444-bd51-77d4256ef221 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:29.006240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 357/717] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:29.039223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd7fda-0d84-404b-b124-67f45abb9326 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.039730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd7fda-0d84-404b-b124-67f45abb9326 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.039730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd7fda-0d84-404b-b124-67f45abb9326 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.041472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 361/718] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:29.047292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ee99a-3fd3-434f-8609-1104ab024aff None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.047583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ee99a-3fd3-434f-8609-1104ab024aff None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.047857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ee99a-3fd3-434f-8609-1104ab024aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.067683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4f0ee99a-3fd3-434f-8609-1104ab024aff None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:29.068925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4f0ee99a-3fd3-434f-8609-1104ab024aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:29.146840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 358/719] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:29.338141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc823-0d1b-4336-b2f6-830f4dd5699c None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.338534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc823-0d1b-4336-b2f6-830f4dd5699c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.338763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc823-0d1b-4336-b2f6-830f4dd5699c None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.340234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 362/720] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:29.345702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.346250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.346732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.365453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:29.366958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:29.376896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:29.427276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc823-0d1b-4336-b2f6-830f4dd5699c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:29.441256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:29.445199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 359/721] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:29.537655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc823-0d1b-4336-b2f6-830f4dd5699c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:29.573394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:29.574293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.574719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.575134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.575978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:29.577484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:29.587433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:29.588699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:29.589764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:29.592212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 363/722] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:29.598904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:29.707690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418466a-4243-4348-afaf-8d2c4aa19cf7 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:29.735410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:29.744777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:29.745390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.745711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.746013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.747128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:29.747128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:29.748413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:29.754221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 360/723] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:29.759486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:29.782146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:29.823555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:29.850272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421339c-e048-4ec8-a727-ac77d5e3de00 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:29.871161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0af58-2597-43d4-9807-ea9e5c242571 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:29.886543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:29.887491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.887975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.888446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.889255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:29.891147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:29.900529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:29.901528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 05:50:29.902440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:29.905100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 364/724] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:29.910924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:29.915258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:29.916070 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:29.916349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:29.916622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:29.917257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:29.918468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:29.919868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:29.931126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:29.932126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:30.022281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:30.045191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c533-6226-4895-be7e-36f2fb78743c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:30.054766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951fef-de73-4ca4-b69e-32786f9cd813 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:30.083800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:30.084725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:30.085204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:30.085721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:30.086533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:30.086985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:30.088535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:30.092674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:30.093490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:30.093999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:30.094445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:30.095270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:30.096843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:30.098989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 365/726] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:30.100341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:30.103676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:30.130027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 362/727] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:30.230553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b5857-8bbc-4352-91c2-4c807ce1e2fa None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:30.277883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:30.278498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:30.278773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:30.279088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:30.279781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:30.280088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:30.281541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a3671-4592-48c6-b2d5-85038a12373f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:30.291707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 366/728] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 05:50:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:30.295797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:30.412574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981bd72-3ed2-4229-ab45-f12c370fcd6f None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:30.441914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:30.452113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204cd67-c064-423c-81e9-08ab673d1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:30.453105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204cd67-c064-423c-81e9-08ab673d1ead None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:30.453672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204cd67-c064-423c-81e9-08ab673d1ead None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:30.454225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204cd67-c064-423c-81e9-08ab673d1ead None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:30.455091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204cd67-c064-423c-81e9-08ab673d1ead None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:30.456735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204cd67-c064-423c-81e9-08ab673d1ead None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:30.480946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 363/729] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:30.611402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4f15-d0fe-4ab4-a794-2e517b8dd050 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:30.611734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4f15-d0fe-4ab4-a794-2e517b8dd050 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:30.611958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4f15-d0fe-4ab4-a794-2e517b8dd050 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:30.613410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 367/730] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:30.619648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae5aff-0993-4085-ada8-68cf6b57fc12 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:30.620193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae5aff-0993-4085-ada8-68cf6b57fc12 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:30.620193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae5aff-0993-4085-ada8-68cf6b57fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:30.641463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-11ae5aff-0993-4085-ada8-68cf6b57fc12 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:30.642722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-11ae5aff-0993-4085-ada8-68cf6b57fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:30.721435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 364/731] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:30.994700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb4f15-d0fe-4ab4-a794-2e517b8dd050 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:31.061028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:31.103062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb4f15-d0fe-4ab4-a794-2e517b8dd050 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:31.141769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fba23-fe26-4108-9d5c-b7fe60c23612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:31.142414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fba23-fe26-4108-9d5c-b7fe60c23612 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:31.142837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fba23-fe26-4108-9d5c-b7fe60c23612 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:31.143109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fba23-fe26-4108-9d5c-b7fe60c23612 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:31.143793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fba23-fe26-4108-9d5c-b7fe60c23612 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:31.145200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fba23-fe26-4108-9d5c-b7fe60c23612 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:31.164602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 368/732] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:30 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:31.250768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0606-a4fc-48ef-bba7-d6d9413cd8ed None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:31.250944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0606-a4fc-48ef-bba7-d6d9413cd8ed None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:31.251223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0606-a4fc-48ef-bba7-d6d9413cd8ed None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:31.252959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 365/733] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:31.258700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5bf5-79ce-43e7-9ec4-2c9c756edeb4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:31.259084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5bf5-79ce-43e7-9ec4-2c9c756edeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:31.259265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5bf5-79ce-43e7-9ec4-2c9c756edeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:31.279172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-df3a5bf5-79ce-43e7-9ec4-2c9c756edeb4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:31.280367 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-df3a5bf5-79ce-43e7-9ec4-2c9c756edeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:31.359613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 369/734] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:31.640684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0606-a4fc-48ef-bba7-d6d9413cd8ed None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:31.743455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0606-a4fc-48ef-bba7-d6d9413cd8ed None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:31.754194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:31.779643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72e791-ba55-4d1d-b986-d45c7dc877cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:31.780242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72e791-ba55-4d1d-b986-d45c7dc877cf None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:31.780515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72e791-ba55-4d1d-b986-d45c7dc877cf None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:31.780783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72e791-ba55-4d1d-b986-d45c7dc877cf None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:31.781433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72e791-ba55-4d1d-b986-d45c7dc877cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:31.782824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72e791-ba55-4d1d-b986-d45c7dc877cf None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:31.800149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 366/735] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:31 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:32.458324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c742a-7c51-491d-a975-72bebc852a24 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:32.458850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c742a-7c51-491d-a975-72bebc852a24 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:32.458850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c742a-7c51-491d-a975-72bebc852a24 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:32.460459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 370/736] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:32.466443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bdfe-f695-486b-8196-9aa0792b9223 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:32.466725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bdfe-f695-486b-8196-9aa0792b9223 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:32.466989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bdfe-f695-486b-8196-9aa0792b9223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:32.486295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6616bdfe-f695-486b-8196-9aa0792b9223 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:32.487472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6616bdfe-f695-486b-8196-9aa0792b9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:32.567589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 367/737] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:32 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:32.743048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296244-cbcc-4594-88d3-02dc888d5d49 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:32.743048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296244-cbcc-4594-88d3-02dc888d5d49 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:32.743287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296244-cbcc-4594-88d3-02dc888d5d49 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:32.744794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 371/738] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:32.751121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:32.751591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:32.751867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:32.771039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:32.772188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:32.840389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 368/739] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:32 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:32.850852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296244-cbcc-4594-88d3-02dc888d5d49 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:32.902014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:32.959119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296244-cbcc-4594-88d3-02dc888d5d49 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.003728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.004273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.004547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.004820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.005404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.006780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:33.016474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:33.017480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.018361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 372/740] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:33.026124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.054045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:33.134306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665cb8-344f-4a74-9442-3bae82fd2598 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.142060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.172055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.172722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.173002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.173277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.173981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:33.174286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.175883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.181663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 369/741] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:33.187425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.254593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bf6c4-eb7f-495b-bb28-c318b7fdc0f4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.269040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:33.292869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:33.293178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.294822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.295278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.295736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.296548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.298220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.301079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING keystone.server.flask.common [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 20 05:50:33.311354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b3ce2-ce03-4160-8114-c0a766ea05c6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.321670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.sql.core [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 05:50:33.321670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 05:50:33.321670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [parameters: {'id': 'ea29e50e5859460395e39f4734319c8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 05:50:33.321670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea29e50e5859460395e39f4734319c8c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea29e50e5859460395e39f4734319c8c. Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:50:33.330523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 05:50:33.331394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application yield resource Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise self.value Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application session.commit() Oct 20 05:50:33.332390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.flush() Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application compat.raise_( Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 05:50:33.333309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 05:50:33.334257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:50:33.335071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [parameters: {'id': 'ea29e50e5859460395e39f4734319c8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.335961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:33.337477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea29e50e5859460395e39f4734319c8c. Oct 20 05:50:33.340255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.342900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 373/742] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Oct 20 05:50:33 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:33.348903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.368354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.369610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.370120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.370666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.371521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:33.372188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.374088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.381295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 370/743] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:33.392095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.468872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6caa1-7576-4c55-ae57-ccc6de779e91 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.507192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.507549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579bc8-4865-4e11-9dcb-1f2f44dfa9d1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.507732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.508552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.508821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.516076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.518546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-7732189f-cd46-4b71-bb9e-d05b3b55e431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:33.530865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:33.531771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:33.532680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 374/744] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:33.533788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80dc2-aeb4-4b42-9530-558bf0052b53 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.533959 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80dc2-aeb4-4b42-9530-558bf0052b53 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.534188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80dc2-aeb4-4b42-9530-558bf0052b53 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.541781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 375/745] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:33.541781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80dc2-aeb4-4b42-9530-558bf0052b53 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.552741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.553499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.553800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.554069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.555288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] RBAC: Adding query filter params (interface=admin, service_id=0121cc07522c438f9f214a56eb24023a, region_id=RegionOne) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:33.555729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.557089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752752b7-0934-4265-b20f-f80c0c08f9a3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.563064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 371/746] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/endpoints?service_id=0121cc07522c438f9f214a56eb24023a&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:33.564204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.564485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.564751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.574364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:33.584691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:33.585882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:33.600587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:33.659668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80dc2-aeb4-4b42-9530-558bf0052b53 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.662463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 372/747] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:33 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:33.663325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:33.714949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.716189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.717038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.717537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.718427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:33.718936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.721392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.750212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 376/748] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:33.776812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c718e3-5dbc-46c9-8ab5-b23b0f59a9a3 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:33.816711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae0d07-1368-453e-907c-18056338ab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:33.817727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0d07-1368-453e-907c-18056338ab12 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:33.818238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0d07-1368-453e-907c-18056338ab12 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:33.818727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0d07-1368-453e-907c-18056338ab12 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:33.819539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae0d07-1368-453e-907c-18056338ab12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:33.821685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae0d07-1368-453e-907c-18056338ab12 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:33.834048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 373/749] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:50:33.936304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.050771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:34.065429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957de191-f99d-44ca-86a2-02db60081ee8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.066426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba01d5-abd7-4d6d-81c2-0ce351d8ed7e None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.066706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba01d5-abd7-4d6d-81c2-0ce351d8ed7e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.066980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba01d5-abd7-4d6d-81c2-0ce351d8ed7e None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.068499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 374/750] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:34.074575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.074920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.075295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.095534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:34.096970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:34.104323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.104952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.105425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:34.105565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.105565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.106095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.107602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:34.116585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:34.118175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:34.119124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 377/751] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:34.124361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.176303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 375/752] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:34.232143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58a76-1efd-422f-9d30-7c49d2d28741 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.266595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.267199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.267470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.267737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.268361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:34.268655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.270029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.280345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 378/753] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:34.281709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.385761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e963-a576-4978-ad07-40f7c8452c30 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.420908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.421515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.421851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.422124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.422748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:34.423090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.424460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.433870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 376/754] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:34.435899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.455990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.459900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:34.464918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:34.547497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06cceb-d240-4b81-8c5d-1e1659d698dd None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.569363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a458e-4388-4bfa-acda-90790872f0cf None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.592479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.593094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.593370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.593641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.594516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] RBAC: Adding query filter params (interface=public, service_id=f645142ecd964488900972e0e640e23a, region_id=RegionOne) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:34.594954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.596465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.605829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 379/755] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/endpoints?service_id=f645142ecd964488900972e0e640e23a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:34.609634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.612307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.613403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.613945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.614571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] PATH_INFO: `/v3/services/image` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.615357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.617013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:34.628320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:34.629384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:34.630286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:34.638105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 377/756] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:34.640281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.700950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:34.719308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:34.724498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a3a34-e0db-4b14-aa97-3a8e1f4778c9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.760433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.761043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.761323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.761596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.762235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.763720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.766170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3cfc-0aa4-426c-bba8-013c7c97346c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.777269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 380/757] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 05:50:34.810311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.811002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.811220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.811495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.812150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] RBAC: Adding query filter params (name=image) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:34.812460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.813949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.820677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 378/758] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:34.826789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:34.946713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d6d15-6d61-4d0a-b9f5-f61520ce6b61 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:34.989838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:34.990450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:34.990726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:34.990996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:34.991679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] RBAC: Adding query filter params (type=image) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:34.991982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:34.993924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:34.999747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 381/759] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:35.006063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:35.110828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5073c-9bc4-4103-aaf8-6cf655540547 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:35.146065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:35.146664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:35.146941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:35.147208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:35.147901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] RBAC: Adding query filter params (interface=public, service_id=3fd255af9c6b410cb480e9632efd3b79, region_id=RegionOne) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:35.148203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:35.149877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d9cac-5cd6-4b3d-a83b-7c732fc5152a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:35.151379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:35.155876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 379/760] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:50:35 2022] GET /identity/v3/endpoints?service_id=3fd255af9c6b410cb480e9632efd3b79&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:35.161916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:35.174755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:35.272628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116122c-3f10-48f6-b786-181d6ad18913 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:35.309616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c119e4f-a9c9-4c9f-a2ca-27847531df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:35.310594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119e4f-a9c9-4c9f-a2ca-27847531df8e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:35.311102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119e4f-a9c9-4c9f-a2ca-27847531df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:35.311594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119e4f-a9c9-4c9f-a2ca-27847531df8e None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:35.312394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c119e4f-a9c9-4c9f-a2ca-27847531df8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:35.313995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c119e4f-a9c9-4c9f-a2ca-27847531df8e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:35.321573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 382/761] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:50:35 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:50:36.131840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959254-199a-470f-a215-6889e1cf1e03 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.132353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959254-199a-470f-a215-6889e1cf1e03 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.132353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959254-199a-470f-a215-6889e1cf1e03 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.134624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 380/762] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:36.139917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.140583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.140775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.169535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1a4e6-0dc4-4721-bbdd-20c2f26f5670 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.169879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1a4e6-0dc4-4721-bbdd-20c2f26f5670 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.170108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1a4e6-0dc4-4721-bbdd-20c2f26f5670 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.171777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 381/763] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:36.177811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.178123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.178379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.199624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:36.200906 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:36.274513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:36.275855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 382/764] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:36.275993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:36.343887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 383/765] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:36.547659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:36.614304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:36.616409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:36.663821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e9b09-60b7-44ed-b4d4-5b0c92b00d9d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:36.700315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:36.710379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:36.711106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.711452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.711750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.712334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:36.714452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:36.725418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:36.726499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:36.727874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 383/766] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 05:50:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:36.733371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:36.739066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4d540-8312-43f9-b1dc-0ed8558583ed None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:36.777947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:36.778890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.779366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.779854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.780677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:36.782317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:36.797755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.sql.core [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 05:50:36.797755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 05:50:36.797755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [parameters: {'user_id': 'cde2f5d1624b4485b980cd4d732e50fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 05:50:36.797755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:50:36.806324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:50:36.807231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application yield resource Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise self.value Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application session.commit() Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 05:50:36.808215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.session.flush() Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application compat.raise_( Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 05:50:36.809092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:50:36.810000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application result.read() Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:50:36.810859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cde2f5d1624b4485b980cd4d732e50fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:36.811696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 20 05:50:36.812479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 20 05:50:36.813421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 20 05:50:36.813421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 20 05:50:36.813421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 05:50:36.813421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 05:50:36.813421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 05:50:36.813421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:36.822011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 384/767] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 05:50:36 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:36.827244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:36.848094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282149-fa88-4ae9-bbed-5246ba6449bd None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:36.884140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:36.884769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:36.885091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:36.885361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:36.886108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:36.886405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:36.887765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:36.893637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 384/768] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:36.899391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:36.901002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:36.954595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18234-768f-450b-9615-3b0c0c72a4cc None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:36.990145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:37.004042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:37.004878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.005257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.006308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.017216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:37.019516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:37.037596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:37.038778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 05:50:37.039874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:37.041844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 385/769] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:37.045417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:37.050386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed75e-04d4-42e2-8276-d9de2c6237a3 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:37.087223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:37.088289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.088806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.089273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.090265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:37.090818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:37.092404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736720f6-ff01-423a-9488-a5d416ab351f None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:37.102769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 385/770] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 05:50:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:37.102769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad15091-2dab-4919-bc76-52d1da7b4442 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.102769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad15091-2dab-4919-bc76-52d1da7b4442 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.102769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad15091-2dab-4919-bc76-52d1da7b4442 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.105057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 386/771] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:37.105700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad15091-2dab-4919-bc76-52d1da7b4442 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:37.161883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1d56-367f-4513-9354-00afe953a7af None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:37.189264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:37.203663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:37.204699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.204985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.205533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.206271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:37.206684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:37.208320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae5185-89ce-4f9c-af66-3a038a91e91c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:37.213903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad15091-2dab-4919-bc76-52d1da7b4442 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:37.234055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:37.248738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bdcbf-fc9c-47eb-8b49-f14c3b28f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:37.249353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bdcbf-fc9c-47eb-8b49-f14c3b28f2cb None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.249632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bdcbf-fc9c-47eb-8b49-f14c3b28f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.262249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bdcbf-fc9c-47eb-8b49-f14c3b28f2cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.262450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 386/772] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 05:50:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:37.262532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bdcbf-fc9c-47eb-8b49-f14c3b28f2cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:37.262624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204999-37d8-4b88-b762-1bbaf2a18b1c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.262624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204999-37d8-4b88-b762-1bbaf2a18b1c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.262624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204999-37d8-4b88-b762-1bbaf2a18b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.262825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bdcbf-fc9c-47eb-8b49-f14c3b28f2cb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:37.281677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 387/773] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:37.290804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8e204999-37d8-4b88-b762-1bbaf2a18b1c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:37.292423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8e204999-37d8-4b88-b762-1bbaf2a18b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:37.380781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 387/774] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:37 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:37.552540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47199-f0f3-440a-907b-1ef2fba865e2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.552823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47199-f0f3-440a-907b-1ef2fba865e2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.553096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47199-f0f3-440a-907b-1ef2fba865e2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.554761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 388/775] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:37.560059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.560346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.560621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.587299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:37.588630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:37.656628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47199-f0f3-440a-907b-1ef2fba865e2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:37.657110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 388/776] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:37 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:37.763170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47199-f0f3-440a-907b-1ef2fba865e2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:37.796472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:37.797094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.797370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.797644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.798250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:37.799617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:37.808956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:37.809956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:37.811116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 389/777] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:37.816249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:37.855854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:37.915221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810ca18-8665-444f-8fbf-f53f29bad2be None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:37.932711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:37.952686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:37.953667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:37.953970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:37.954242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:37.954865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:37.955161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:37.956953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:37.963494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 389/778] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:37.968775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:37.983435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:38.039793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d2fa-539c-4a22-84e7-30036dfe14e0 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:38.077091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:38.077911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:38.078198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:38.078467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] PATH_INFO: `/v3/services/image` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:38.079049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:38.080501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:38.088679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc2e92-9386-4593-b1d4-21ec5de47c53 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:38.090068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:38.091091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 05:50:38.091977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:38.092721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:38.092791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 390/779] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Oct 20 05:50:37 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:38.097030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:38.128656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:38.129264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:38.129538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:38.129868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:38.130461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:38.130764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:38.132116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:38.142112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 390/780] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 05:50:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:38.143737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:38.202071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffa5a6-f45f-4b35-bf99-15a1e2e2cb09 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:38.211203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:38.238004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:38.238687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:38.238908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:38.239173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:38.239814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:38.240118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:38.241542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:38.253021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 391/781] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:38.253895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:38.254877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60c64-28cc-4330-ac43-e3177cf4c17c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:38.293896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:38.294497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:38.294772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:38.295039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:38.295692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:38.297430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:38.320912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 391/782] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 05:50:38.369790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5fa03-3eee-4e49-a01c-9e0d314c8ca4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:38.413628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:38.414925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:38.415200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:38.415470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:38.416103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] RBAC: Adding query filter params (type=image) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:38.416401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:38.417802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7975c21-b1d8-4f0c-94ba-3af04c984445 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:38.423370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 392/783] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:38.429174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:38.458163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:38.542929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2918-0046-4f61-a7b9-61bca19acb2c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:38.576638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18bd2-ef25-4d69-8f2f-67fc776bf846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:38.577245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18bd2-ef25-4d69-8f2f-67fc776bf846 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:38.577517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18bd2-ef25-4d69-8f2f-67fc776bf846 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:38.577821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18bd2-ef25-4d69-8f2f-67fc776bf846 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:38.578474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18bd2-ef25-4d69-8f2f-67fc776bf846 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:38.579822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18bd2-ef25-4d69-8f2f-67fc776bf846 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:38.600559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 392/784] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:50:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:39.526151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752d6e-9d19-4b18-a726-e42c486396ce None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:39.526693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752d6e-9d19-4b18-a726-e42c486396ce None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:39.526693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752d6e-9d19-4b18-a726-e42c486396ce None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:39.528061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 393/785] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:39.533204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:39.533579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:39.533776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:39.552030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:39.553192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:39.629087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 393/786] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:39.893303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752d6e-9d19-4b18-a726-e42c486396ce None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:39.925921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:40.006295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752d6e-9d19-4b18-a726-e42c486396ce None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:40.041672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f80c05-8738-492a-9ed8-219c70387868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:40.042335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80c05-8738-492a-9ed8-219c70387868 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:40.042617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80c05-8738-492a-9ed8-219c70387868 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:40.042889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80c05-8738-492a-9ed8-219c70387868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:40.043999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f80c05-8738-492a-9ed8-219c70387868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:40.045429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f80c05-8738-492a-9ed8-219c70387868 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:40.049788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 394/787] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:40.053006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:40.056276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:40.155239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8498-5b07-49e4-97aa-a9b4bbacfe03 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:40.188959 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe826b-1390-49dc-8200-48d03bd961f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:40.189575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe826b-1390-49dc-8200-48d03bd961f9 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:40.189895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe826b-1390-49dc-8200-48d03bd961f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:40.190173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe826b-1390-49dc-8200-48d03bd961f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:40.190835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe826b-1390-49dc-8200-48d03bd961f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:40.192264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe826b-1390-49dc-8200-48d03bd961f9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:40.225788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 394/788] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:50:40 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:40.557774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063ee4-965a-4360-afd8-9880a7ed484a None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:40.558302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063ee4-965a-4360-afd8-9880a7ed484a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:40.558302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063ee4-965a-4360-afd8-9880a7ed484a None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:40.559691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 395/789] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:40.564719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148b797-3eb4-4782-bde8-7d6089b0e4ae None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:40.565102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148b797-3eb4-4782-bde8-7d6089b0e4ae None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:40.565275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148b797-3eb4-4782-bde8-7d6089b0e4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:40.584182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9148b797-3eb4-4782-bde8-7d6089b0e4ae None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:40.585353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9148b797-3eb4-4782-bde8-7d6089b0e4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:40.639690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:40.658806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 395/790] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:40.794658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69354e82-cac7-4bc1-b094-37eacedf87c8 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:40.794975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69354e82-cac7-4bc1-b094-37eacedf87c8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:40.795218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69354e82-cac7-4bc1-b094-37eacedf87c8 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:40.796692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 396/791] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:40.801665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:40.801988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:40.802268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:40.821141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:40.822362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:40.889165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 396/792] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:40.928097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69354e82-cac7-4bc1-b094-37eacedf87c8 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.038814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:41.044835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69354e82-cac7-4bc1-b094-37eacedf87c8 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.078375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.078924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.079200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.079468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.090569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:41.095357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:41.096269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:41.097146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.102222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 397/793] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:50:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:41.103513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.164560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.210724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0723ca-4d9c-4a6f-aaec-52bda62e0c71 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.230301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:41.250386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.251188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.251631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.252048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.252859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:41.253438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.255408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.269132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 397/794] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:41.270379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.304218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289d439-a75d-4936-9393-a455b3b3fea3 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.341545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.342098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.342378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.342649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.343315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.344676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.352736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.sql.core [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 05:50:41.352736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 05:50:41.352736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [parameters: {'id': '3c2837185fa84fc1a5baa2a6347d0ff4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 05:50:41.352736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:50:41.369058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application result.read() Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 05:50:41.370158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application yield resource Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application next(self.gen) Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise self.value Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application session.commit() Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 05:50:41.371125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self.session.flush() Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application compat.raise_( Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 05:50:41.372088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 05:50:41.372975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application conn.query(q) Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application result.read() Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 05:50:41.373766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [parameters: {'id': '3c2837185fa84fc1a5baa2a6347d0ff4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 05:50:41.375180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:41.376913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 398/795] 10.222.0.16 () {60 vars in 1137 bytes} [Thu Oct 20 05:50:41 2022] POST /identity/v3/domains => generated 190 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:41.379759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.386721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a2c6-76d3-4911-bf7c-a76681580d10 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.407259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:41.425415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.426085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.426365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.426644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.438996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.440937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:41.455593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:41.456573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:41.458259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:41.458259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:41.458259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:41.458259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 398/796] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:41.463014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.494663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397253e-c7d0-4c99-93cf-ad2cce4112ad None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.498459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:41.530573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.531199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.531479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.531749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.543045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.544490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:41.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:41.560006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:41.560893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:41.560893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:41.560893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:41.564900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 399/797] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:41.565624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.577854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062e758-bb33-4171-a6c1-d2d99d35f949 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.612975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.613502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.613810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.614083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.614724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:41.615026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.616388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.634654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 399/798] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:41.635728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.652793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:41.678096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c662-2cee-4842-969a-a187df5f638a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.712099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.712697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.712972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.713236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.713891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:41.714190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.715560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.726910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 400/799] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:41.750495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:41.762930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a7ddf-6ca0-4f6f-b5ea-d0e198b4fe1c None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.799164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.799804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.800077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.800338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.808919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.810411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:41.823044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:41.824129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:41.825086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:41.829135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 400/800] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:41.830493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:41.940913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6cd0b-be94-4378-8bf7-bcbf4dd28c63 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:41.983480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:41.984184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:41.984425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:41.984648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:41.985391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:41.985698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:41.987181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:41.990049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:42.008609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 401/801] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 05:50:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:42.014531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:42.120546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087644-6637-4e9d-a7f3-d6b1a6ce323d None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:42.153454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:42.154106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.154388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.154661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.165584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:42.167058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:42.181436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:42.182548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:42.188033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:42.188033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:42.188033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:42.188033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 401/802] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:42.188258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:42.286212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df0936-1c77-4a28-97ec-d487a876664d None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:42.319528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:42.320135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.321062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.321343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.322012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:42.322320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:42.323698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:42.335245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 402/803] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:42.340792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:42.343647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:42.444673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc940b-b5c1-47ee-a226-dbcc79905d43 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:42.477681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:42.478330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.478610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.478883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.485456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:42.486908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-4c71f6bb-eede-46e2-ad9f-df40eeb0e8f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:42.498642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:42.499523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:42.500407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 402/804] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:42.505512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:42.510059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faad18-878b-4138-b0cb-714af7ebfcc4 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.510333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faad18-878b-4138-b0cb-714af7ebfcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.510600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faad18-878b-4138-b0cb-714af7ebfcc4 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.511879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 403/805] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:42.517107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.517390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.517658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.535207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:42.536427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:42.563769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:42.592546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:42.603546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 404/806] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:42.613518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016435b-5ae8-4b5c-b84d-3fb6b5f8058c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:42.647557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:42.648151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.649073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.649384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.650108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:42.650412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:42.651827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:42.663246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 403/807] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:42.669306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:42.766963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0aaa-ea2f-459f-a06a-10a80936bbad None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:42.799675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:42.800250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:42.800522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:42.800791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/6caa2ac059864911ac3d429df74b693e/roles/e0d18d67ed6f4c189ed341da24855ad3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:42.802898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=6caa2ac059864911ac3d429df74b693e, role_id=e0d18d67ed6f4c189ed341da24855ad3)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:42.804311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:42.816316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 405/808] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:42 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/6caa2ac059864911ac3d429df74b693e/roles/e0d18d67ed6f4c189ed341da24855ad3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:50:42.877404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:42.985519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cb3c9-64d3-4018-bcdb-a3fa54a62369 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:43.000524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:43.021388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3de8ba-803e-472a-a2a4-00b8921d841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:43.022037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de8ba-803e-472a-a2a4-00b8921d841c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:43.022315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de8ba-803e-472a-a2a4-00b8921d841c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:43.022583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de8ba-803e-472a-a2a4-00b8921d841c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:43.024017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3de8ba-803e-472a-a2a4-00b8921d841c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:43.025436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3de8ba-803e-472a-a2a4-00b8921d841c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:43.027024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 404/809] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:43.032795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:43.086979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:43.134248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0a362-6e85-4df0-83cd-3e5d84f5fe41 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:43.168333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc009a-ebe7-46ef-bc15-517f1a560253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:43.168932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc009a-ebe7-46ef-bc15-517f1a560253 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:43.169208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc009a-ebe7-46ef-bc15-517f1a560253 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:43.169476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc009a-ebe7-46ef-bc15-517f1a560253 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:43.170168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc009a-ebe7-46ef-bc15-517f1a560253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:43.171588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc009a-ebe7-46ef-bc15-517f1a560253 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:43.193914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 406/810] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:50:43 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:50:44.983050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2335d-cbbd-4a65-bc2a-570873820f3f None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:44.983476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2335d-cbbd-4a65-bc2a-570873820f3f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:44.983575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2335d-cbbd-4a65-bc2a-570873820f3f None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:44.984903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 405/811] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:44.990333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68110-8ca6-4cc8-aefa-5663f858a0b8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:44.990772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68110-8ca6-4cc8-aefa-5663f858a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:44.990880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68110-8ca6-4cc8-aefa-5663f858a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.009421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-edd68110-8ca6-4cc8-aefa-5663f858a0b8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:45.010630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-edd68110-8ca6-4cc8-aefa-5663f858a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:45.076533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 407/812] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:45.346194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2335d-cbbd-4a65-bc2a-570873820f3f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:45.422722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf09e4-dfb5-4f75-bc48-08375098925d None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.423013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf09e4-dfb5-4f75-bc48-08375098925d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.423291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf09e4-dfb5-4f75-bc48-08375098925d None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.424626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 408/813] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:45.430341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.430754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.431034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.448874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:45.449832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2335d-cbbd-4a65-bc2a-570873820f3f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:45.450091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:45.479252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:45.484114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:45.484791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.485064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.485326 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.496110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:45.501060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:45.502133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:45.503720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 406/814] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:45.509002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:45.518153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 409/815] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:50:45.550446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:45.605252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a51f0-e99b-46e5-abe9-67edba50dcea None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:45.641594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:45.642219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.642495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.642769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.643448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:45.643748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:45.645106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:45.653511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 407/816] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:45.659272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:45.752774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682574a-8c45-41bb-b035-607f40f70ddd None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:45.786278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:45.786895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.787172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.787444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.789784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:45.797900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:45.799331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:45.813840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:45.814814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:45.815715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:45.815715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:45.815715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:45.815715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 410/817] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:45.821259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:45.842547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:45.892391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d391fd-df79-4cae-9bd2-b56a122ca94b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:45.894611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:45.922019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2ade-2580-49ed-aae1-6590a577964b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:45.925535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:45.926175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.926450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.926714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.937087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:45.942272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:45.943309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:45.944176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 408/818] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:45.949300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:45.959899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:45.961267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:45.961766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:45.962067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:45.962710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:45.963032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:45.964412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:45.975999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 411/819] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:45.982101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.054625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00132a9-0642-4173-92a2-360d5cbbab3b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.062231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.080827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27091694-b264-47bb-9dd6-e35e2885cd4f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.087936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.088538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.088817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.089090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.089768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:46.090074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.091446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.099788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 409/820] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:46.106512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.115355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.115974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.116246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.116514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.123799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.125211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.132418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:50:46.136248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:46.137395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:46.138781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 412/821] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 05:50:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:50:46.143214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.206844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b617d9-9307-402b-af44-c8a623eac5eb None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.238603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7dbef-b37e-415f-81dd-6827deb1f0b5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.240706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.241360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.241637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.242433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] PATH_INFO: `/v3/users/8646c95328fd4fd3852ebd987915e921` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.255157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] RBAC: Authorizing `identity:get_user(user_id=8646c95328fd4fd3852ebd987915e921)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.256604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.258392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 410/822] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/users/8646c95328fd4fd3852ebd987915e921 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:46.264015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.273705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.274441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.274716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.274985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.275697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:46.275998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.277411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.286258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.294526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 413/823] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:46.300145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.346791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.363031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c8914-91f3-45ef-8f40-9b0a481971d0 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.396195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.396450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b186-8ffa-44cc-84c3-f553a3f15f26 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.396748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.397027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.397300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] PATH_INFO: `/v3/projects/e90e5a717a8541cfb6620de1deb1ab74` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.398454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] RBAC: Authorizing `identity:get_project(project_id=e90e5a717a8541cfb6620de1deb1ab74)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.399916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.401550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 411/824] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/projects/e90e5a717a8541cfb6620de1deb1ab74 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:50:46.407346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.433368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b941c-a190-4c63-9655-597320589550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.434001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b941c-a190-4c63-9655-597320589550 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.434283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b941c-a190-4c63-9655-597320589550 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.434555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b941c-a190-4c63-9655-597320589550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.496882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.500395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b941c-a190-4c63-9655-597320589550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.502240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b941c-a190-4c63-9655-597320589550 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.503400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85e73-d4c6-4f6a-bab8-8a6e0922f541 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.537021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.537654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.537954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.538220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] PATH_INFO: `/v3/projects/e90e5a717a8541cfb6620de1deb1ab74/users/8646c95328fd4fd3852ebd987915e921/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.540641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e90e5a717a8541cfb6620de1deb1ab74, user_id=8646c95328fd4fd3852ebd987915e921, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.542075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.555042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 412/825] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:46 2022] PUT /identity/v3/projects/e90e5a717a8541cfb6620de1deb1ab74/users/8646c95328fd4fd3852ebd987915e921/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:50:46.602242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 414/826] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:50:46.608388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.624649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.715545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618f20f-895c-493b-8555-a59304ab95d7 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.750892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.751519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.751799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.752073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.762490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.763926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:50:46.778510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:46.779543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:50:46.780459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:50:46.780459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:50:46.780459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:46.780459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 413/827] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:46.785431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b941c-a190-4c63-9655-597320589550 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:46.880897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:46.885165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b941c-a190-4c63-9655-597320589550 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:46.918907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:46.919510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:46.919788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:46.920057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:46.920688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:46.920987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:46.922368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:46.933850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 415/828] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:46.939415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:47.001517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:47.039961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eb101-8471-4396-b6d7-22d1ee7bc604 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:47.073582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:47.074230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:47.074494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:47.074766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:47.082328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:47.083764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:50:47.094919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:47.095885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:50:47.096766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 414/829] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:47.102440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:47.199412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da77ee-e89f-4fdb-87fd-0d354c602641 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:47.232760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:47.233312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:47.233584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:47.233880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:47.234560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:47.234859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:47.236261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a16d31-a86e-40b0-af6c-a9cca5900195 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:47.248469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 416/830] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:47.254522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:47.351216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c7cf-734d-4005-b049-c357b08ddab7 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:47.373894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:47.384603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:47.385196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:47.385640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:47.385961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:47.386675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] RBAC: Adding query filter params (role.id=e0d18d67ed6f4c189ed341da24855ad3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=6caa2ac059864911ac3d429df74b693e) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:47.386977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:47.388395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88200b9e-0b2d-446f-922f-9f396f3c5ebb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:47.394238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 415/831] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:47 2022] GET /identity/v3/role_assignments?user.id=6caa2ac059864911ac3d429df74b693e&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=e0d18d67ed6f4c189ed341da24855ad3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:48.696943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76bdc-3158-494d-a2f5-1d19e9a159b8 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:48.697474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76bdc-3158-494d-a2f5-1d19e9a159b8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:48.697474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76bdc-3158-494d-a2f5-1d19e9a159b8 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:48.698829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 417/832] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:50:48.703913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:48.704356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:48.704450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:48.722227 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:48.723393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:48.787703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 416/833] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:49.052864 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76bdc-3158-494d-a2f5-1d19e9a159b8 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:49.072307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:49.152253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76bdc-3158-494d-a2f5-1d19e9a159b8 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:49.184452 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:49.185058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:49.185336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:49.185606 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:49.195869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:50:49.200607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:50:49.201668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:50:49.202585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 418/834] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:50:49.207615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:49.303995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c966ca-c5fd-4557-ae91-1774cd48697e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:49.322972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:49.340058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:49.340653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:49.340927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:49.341197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:49.341882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:49.342182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:49.343557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:49.351763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 417/835] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:49.357539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:49.433001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:49.453583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423b073-6a33-40d0-88d4-9f08f3400251 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:49.485403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:49.486032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:49.486307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:49.486575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] PATH_INFO: `/v3/users/8646c95328fd4fd3852ebd987915e921` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:49.487665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=8646c95328fd4fd3852ebd987915e921)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:49.489075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:49.490617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 419/836] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:50:49 2022] GET /identity/v3/users/8646c95328fd4fd3852ebd987915e921 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:49.497013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:49.595029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341262b0-380b-4ea9-8219-81831ac4e02e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:49.627940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:49.628529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:49.628802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:49.629068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:49.677576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:49.697252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:49.698715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:49.792004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 418/837] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:50:49.797868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:49.891911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdaca2-b8f2-4326-a38a-26f037fa0ce2 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:49.924491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10267390-6011-43c3-8fce-402863f77bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:49.925105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10267390-6011-43c3-8fce-402863f77bdb None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:49.925383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10267390-6011-43c3-8fce-402863f77bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:49.925655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10267390-6011-43c3-8fce-402863f77bdb None admin] PATH_INFO: `/v3/projects/e90e5a717a8541cfb6620de1deb1ab74` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:49.926792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10267390-6011-43c3-8fce-402863f77bdb None admin] RBAC: Authorizing `identity:get_project(project_id=e90e5a717a8541cfb6620de1deb1ab74)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:49.928216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10267390-6011-43c3-8fce-402863f77bdb None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:49.929970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 420/838] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:50:49 2022] GET /identity/v3/projects/e90e5a717a8541cfb6620de1deb1ab74 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:49.935766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:50.013121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:50.032421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1ad2b-25a5-4fa1-81a5-c6eda6027e83 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:50.065245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:50.065871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:50.066151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:50.066424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:50.067135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=e90e5a717a8541cfb6620de1deb1ab74, user.id=8646c95328fd4fd3852ebd987915e921) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:50.067442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:50.068859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602691d-2cd2-4f07-a5c8-62b37c43c2cd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:50.074709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 419/839] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:49 2022] GET /identity/v3/role_assignments?user.id=8646c95328fd4fd3852ebd987915e921&scope.project.id=e90e5a717a8541cfb6620de1deb1ab74&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:52.184674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8595-9ada-4a3f-b636-55a6cf8b8aa9 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:52.185224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8595-9ada-4a3f-b636-55a6cf8b8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:52.185224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8595-9ada-4a3f-b636-55a6cf8b8aa9 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:52.186559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 421/840] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:52.191766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:52.192164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:52.192315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:52.210774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:52.211981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:52.276364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 420/841] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:52.545424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8595-9ada-4a3f-b636-55a6cf8b8aa9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:52.562314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:52.643539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8595-9ada-4a3f-b636-55a6cf8b8aa9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:52.675543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48172a-b924-4d7f-9808-1cbdea53b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:52.676147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48172a-b924-4d7f-9808-1cbdea53b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:52.676421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48172a-b924-4d7f-9808-1cbdea53b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:52.676687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48172a-b924-4d7f-9808-1cbdea53b4d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:52.677784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48172a-b924-4d7f-9808-1cbdea53b4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:52.679198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48172a-b924-4d7f-9808-1cbdea53b4d7 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:52.680763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 422/842] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:52.686533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:52.759339 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:52.783430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2158cb-88f3-4cf5-bf9c-e9dde9f52348 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:52.816067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c127-30ea-4e90-a0ed-3a0417ad0920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:52.816657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c127-30ea-4e90-a0ed-3a0417ad0920 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:52.816933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c127-30ea-4e90-a0ed-3a0417ad0920 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:52.817202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c127-30ea-4e90-a0ed-3a0417ad0920 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:52.817884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c127-30ea-4e90-a0ed-3a0417ad0920 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:52.819310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c127-30ea-4e90-a0ed-3a0417ad0920 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:52.840784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 421/843] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:50:52 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 05:50:54.965304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937f8e-bd72-4a1e-80ea-8fcb0a15694e None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:54.965871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937f8e-bd72-4a1e-80ea-8fcb0a15694e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:54.965965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937f8e-bd72-4a1e-80ea-8fcb0a15694e None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:54.967210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 423/844] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:54.972472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:54.972844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:54.973007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:54.991613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:54.993363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:55.057809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 422/845] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:55.329488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6937f8e-bd72-4a1e-80ea-8fcb0a15694e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:55.408491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:55.427267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6937f8e-bd72-4a1e-80ea-8fcb0a15694e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:55.459572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:55.460181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:55.460458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:55.460725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] PATH_INFO: `/v3/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:55.462106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] RBAC: Authorizing `identity:get_role(role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:55.463450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:55.464734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 424/846] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:50:55 2022] GET /identity/v3/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:55.470390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:55.526874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:55.567628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9047-5325-49fe-92c7-40dba7e78ebb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:55.599594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:55.600148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:55.600421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:55.600688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] PATH_INFO: `/v3/users/0da7795b923040a0825d6165a1f12b4b` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:55.613534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] RBAC: Authorizing `identity:get_user(user_id=0da7795b923040a0825d6165a1f12b4b)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:55.614998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:55.616556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 423/847] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:50:55 2022] GET /identity/v3/users/0da7795b923040a0825d6165a1f12b4b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:55.623501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:55.721342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96be136-bd09-471c-ab37-540575feb8ec None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:55.753730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996a476-3782-47be-8b38-5236110aa164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:55.754372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996a476-3782-47be-8b38-5236110aa164 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:55.754651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996a476-3782-47be-8b38-5236110aa164 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:55.754920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996a476-3782-47be-8b38-5236110aa164 None admin] PATH_INFO: `/v3/projects/e90e5a717a8541cfb6620de1deb1ab74` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:55.756025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996a476-3782-47be-8b38-5236110aa164 None admin] RBAC: Authorizing `identity:get_project(project_id=e90e5a717a8541cfb6620de1deb1ab74)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:55.757495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996a476-3782-47be-8b38-5236110aa164 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:55.759215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 425/848] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:50:55 2022] GET /identity/v3/projects/e90e5a717a8541cfb6620de1deb1ab74 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:55.765456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:55.861585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965dc39-f347-4c7c-ba24-0befc4c89edf None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:55.878443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:55.895505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e6da-f921-4025-87bf-d5851018cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:55.896139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e6da-f921-4025-87bf-d5851018cf56 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:55.896413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e6da-f921-4025-87bf-d5851018cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:55.896675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e6da-f921-4025-87bf-d5851018cf56 None admin] PATH_INFO: `/v3/projects/e90e5a717a8541cfb6620de1deb1ab74/users/0da7795b923040a0825d6165a1f12b4b/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:55.898930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e6da-f921-4025-87bf-d5851018cf56 None admin] RBAC: Authorizing `identity:create_grant(project_id=e90e5a717a8541cfb6620de1deb1ab74, user_id=0da7795b923040a0825d6165a1f12b4b, role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:55.900335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e6da-f921-4025-87bf-d5851018cf56 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:55.912362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 424/849] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:50:55 2022] PUT /identity/v3/projects/e90e5a717a8541cfb6620de1deb1ab74/users/0da7795b923040a0825d6165a1f12b4b/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:50:58.020588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56283-42cb-40c8-80e2-e08b811f3cbc None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:58.021026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56283-42cb-40c8-80e2-e08b811f3cbc None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:58.021132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56283-42cb-40c8-80e2-e08b811f3cbc None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:58.022495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 426/850] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:50:58.027916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:58.028310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:58.028458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:58.046224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:50:58.047397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:50:58.111875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 425/851] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:50:58.383198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56283-42cb-40c8-80e2-e08b811f3cbc None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:58.402730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:58.480783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56283-42cb-40c8-80e2-e08b811f3cbc None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:58.512632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:58.513235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:58.513510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:58.513799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] PATH_INFO: `/v3/roles/b73e3a3a46cf4bfaaffedeae6ece231e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:58.515386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] RBAC: Authorizing `identity:get_role(role_id=b73e3a3a46cf4bfaaffedeae6ece231e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:58.516744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:58.518058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 427/852] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:50:58 2022] GET /identity/v3/roles/b73e3a3a46cf4bfaaffedeae6ece231e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:58.524281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:58.617743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b867b5-a231-428e-afa0-2d533d0709bc None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:58.627235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:58.653329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:58.653899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:58.654175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:58.654443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] PATH_INFO: `/v3/users/0da7795b923040a0825d6165a1f12b4b` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:58.655539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] RBAC: Authorizing `identity:get_user(user_id=0da7795b923040a0825d6165a1f12b4b)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:58.656957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:58.658529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 426/853] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:50:58 2022] GET /identity/v3/users/0da7795b923040a0825d6165a1f12b4b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:58.664284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:58.745092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:58.760279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305e36-6068-493f-9a7d-4cfa72d7b7c2 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:58.792567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:58.793162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:58.793441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:58.793715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:58.860040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:58.861466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:58.942427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:50:58.957944 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 428/854] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:50:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:50:58.964300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:59.060578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0426-a597-46ab-8208-f2b0863196e1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:59.094181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e21a-cfaa-42b9-a5e7-ed1f28d7acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:59.094796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e21a-cfaa-42b9-a5e7-ed1f28d7acce None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:59.095071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e21a-cfaa-42b9-a5e7-ed1f28d7acce None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:59.095343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e21a-cfaa-42b9-a5e7-ed1f28d7acce None admin] PATH_INFO: `/v3/projects/e90e5a717a8541cfb6620de1deb1ab74` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:59.096429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e21a-cfaa-42b9-a5e7-ed1f28d7acce None admin] RBAC: Authorizing `identity:get_project(project_id=e90e5a717a8541cfb6620de1deb1ab74)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:59.097878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e21a-cfaa-42b9-a5e7-ed1f28d7acce None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:59.099465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 427/855] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:50:58 2022] GET /identity/v3/projects/e90e5a717a8541cfb6620de1deb1ab74 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:50:59.106207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:50:59.201072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20cf27-604e-42fe-84f9-648b3ca2e66f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:50:59.233236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:50:59.233850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:50:59.234133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:50:59.234405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:50:59.235117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] RBAC: Adding query filter params (role.id=b73e3a3a46cf4bfaaffedeae6ece231e, scope.project.id=e90e5a717a8541cfb6620de1deb1ab74, user.id=0da7795b923040a0825d6165a1f12b4b) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:50:59.235424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:50:59.236831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e38a3-4bd7-4f0f-bf5c-4d82a2a3010e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:50:59.243304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 429/856] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:50:59 2022] GET /identity/v3/role_assignments?user.id=0da7795b923040a0825d6165a1f12b4b&scope.project.id=e90e5a717a8541cfb6620de1deb1ab74&role.id=b73e3a3a46cf4bfaaffedeae6ece231e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:01.374257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c71699-28ea-4d44-ad77-37fc31aa940e None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:01.374778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c71699-28ea-4d44-ad77-37fc31aa940e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:01.374778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c71699-28ea-4d44-ad77-37fc31aa940e None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:01.376125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 428/857] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:01.381257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:01.381626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:01.381850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:01.400880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:01.402087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:01.446067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:01.466499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 430/858] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:01.733635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c71699-28ea-4d44-ad77-37fc31aa940e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:01.779280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:01.831794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c71699-28ea-4d44-ad77-37fc31aa940e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:01.863323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7f6f-e614-4180-8d38-75fb0956aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:01.863936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7f6f-e614-4180-8d38-75fb0956aef7 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:01.864210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7f6f-e614-4180-8d38-75fb0956aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:01.864476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7f6f-e614-4180-8d38-75fb0956aef7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:01.865840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b7f6f-e614-4180-8d38-75fb0956aef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:01.867774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b7f6f-e614-4180-8d38-75fb0956aef7 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:01.869293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 429/859] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:51:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:01.875043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:01.970694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9301a7-554e-48aa-b715-887ed335e665 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:02.003428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e4f3b-900e-4e3d-8f56-c29fb6602764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:02.003966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e4f3b-900e-4e3d-8f56-c29fb6602764 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:02.004242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e4f3b-900e-4e3d-8f56-c29fb6602764 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:02.004513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e4f3b-900e-4e3d-8f56-c29fb6602764 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:02.005158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e4f3b-900e-4e3d-8f56-c29fb6602764 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:02.006605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e4f3b-900e-4e3d-8f56-c29fb6602764 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:02.032145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 431/860] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:51:01 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:51:04.159559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da796f38-79ff-4a39-a717-4c274ca1c716 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:04.160105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da796f38-79ff-4a39-a717-4c274ca1c716 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:04.160105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da796f38-79ff-4a39-a717-4c274ca1c716 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:04.161427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 430/861] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:04.167282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:04.167703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:04.167820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:04.185428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:04.186617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:04.211280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:04.251900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 432/862] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:04.528540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da796f38-79ff-4a39-a717-4c274ca1c716 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:04.628155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da796f38-79ff-4a39-a717-4c274ca1c716 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:04.641192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:04.661750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982fdf6-88c4-4cfe-8b94-6c750c15360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:04.662377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fdf6-88c4-4cfe-8b94-6c750c15360e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:04.662657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fdf6-88c4-4cfe-8b94-6c750c15360e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:04.662926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fdf6-88c4-4cfe-8b94-6c750c15360e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:04.664728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982fdf6-88c4-4cfe-8b94-6c750c15360e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:04.666225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982fdf6-88c4-4cfe-8b94-6c750c15360e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:04.667766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 431/863] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:04.673500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:04.768744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bfe38-1ee8-4f98-977a-158d618df10f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:04.802522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f4c2-e348-4569-9b52-0cbbb3b71175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:04.803117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f4c2-e348-4569-9b52-0cbbb3b71175 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:04.803395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f4c2-e348-4569-9b52-0cbbb3b71175 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:04.803668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f4c2-e348-4569-9b52-0cbbb3b71175 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:04.804625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f4c2-e348-4569-9b52-0cbbb3b71175 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:04.806073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f4c2-e348-4569-9b52-0cbbb3b71175 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:04.826281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 433/864] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:51:04 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:51:07.022550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120bd5a-2c24-42c6-baee-4bc4ffff2cc2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:07.023446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120bd5a-2c24-42c6-baee-4bc4ffff2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:07.023728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120bd5a-2c24-42c6-baee-4bc4ffff2cc2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:07.025059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 432/865] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:07.030316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:07.031109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:07.031378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:07.048957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:07.050165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:07.063581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:07.115757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 434/866] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:07.382751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120bd5a-2c24-42c6-baee-4bc4ffff2cc2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:07.481329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120bd5a-2c24-42c6-baee-4bc4ffff2cc2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:07.514295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:07.514904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:07.515427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:07.515706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:07.525944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:51:07.530717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:51:07.531791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:51:07.532661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 433/867] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:51:07.537647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:07.633150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ebd33-d61d-4437-b129-d08930cb4d77 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:07.665509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:07.666128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:07.666403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:07.666673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:07.667320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:51:07.667614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:07.668963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:07.676603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 435/868] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:07.683065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:07.724121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:07.781116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da475-9109-491a-9a6c-5e61adec46f4 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:07.813618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:07.814263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:07.814541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:07.814813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] PATH_INFO: `/v3/users/442b8c10d77040f7a13303df2395b4ff` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:07.827738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] RBAC: Authorizing `identity:get_user(user_id=442b8c10d77040f7a13303df2395b4ff)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:07.829177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:07.830781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 434/869] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:51:07 2022] GET /identity/v3/users/442b8c10d77040f7a13303df2395b4ff => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:07.837138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:07.849303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:07.933000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1e2c-7560-4645-8afb-8e5798513516 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:07.965428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47131b7-783e-4a87-9bd2-222d4b1c5f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:07.966074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47131b7-783e-4a87-9bd2-222d4b1c5f3a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:07.966355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47131b7-783e-4a87-9bd2-222d4b1c5f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:07.966631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47131b7-783e-4a87-9bd2-222d4b1c5f3a None admin] PATH_INFO: `/v3/projects/febb40cf1967495297a1c41334e70fe9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:07.967752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47131b7-783e-4a87-9bd2-222d4b1c5f3a None admin] RBAC: Authorizing `identity:get_project(project_id=febb40cf1967495297a1c41334e70fe9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:07.969180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47131b7-783e-4a87-9bd2-222d4b1c5f3a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:07.970839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 436/870] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:51:07 2022] GET /identity/v3/projects/febb40cf1967495297a1c41334e70fe9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:51:07.977341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:08.070631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:08.074688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b446e-56d1-403d-8dec-703ac57933b1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:08.108148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086d88-6013-45af-b943-d8464d227c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:08.108783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086d88-6013-45af-b943-d8464d227c90 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:08.109055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086d88-6013-45af-b943-d8464d227c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:08.109320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086d88-6013-45af-b943-d8464d227c90 None admin] PATH_INFO: `/v3/projects/febb40cf1967495297a1c41334e70fe9/users/442b8c10d77040f7a13303df2395b4ff/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:08.111186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086d88-6013-45af-b943-d8464d227c90 None admin] RBAC: Authorizing `identity:create_grant(project_id=febb40cf1967495297a1c41334e70fe9, user_id=442b8c10d77040f7a13303df2395b4ff, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:08.112593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086d88-6013-45af-b943-d8464d227c90 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:08.124340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 435/871] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:51:07 2022] PUT /identity/v3/projects/febb40cf1967495297a1c41334e70fe9/users/442b8c10d77040f7a13303df2395b4ff/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:51:10.210995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869535c2-ec0c-4752-9036-bde4466a7f3a None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:10.211542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869535c2-ec0c-4752-9036-bde4466a7f3a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:10.211542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869535c2-ec0c-4752-9036-bde4466a7f3a None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:10.212865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 437/872] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:10.218547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:10.218921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:10.219088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:10.349762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:10.351062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:10.415430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 436/873] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:10.681975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869535c2-ec0c-4752-9036-bde4466a7f3a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:10.757679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:10.779313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869535c2-ec0c-4752-9036-bde4466a7f3a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:10.811173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:10.811778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:10.812052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:10.812318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:10.822131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:51:10.826858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:51:10.827840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:51:10.829045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 438/874] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:51:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:51:10.833860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:10.918057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:10.930841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984c51-5c1c-43f3-8740-47ae5c260ce5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:10.963828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:10.964365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:10.964645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:10.964915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:10.965574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:51:10.965904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:10.967269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:10.975253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 437/875] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:10.981876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:11.082921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cf24c-69c0-41cd-a7c1-fb265b5f1fa2 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:11.117364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:11.118002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:11.118282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:11.118553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] PATH_INFO: `/v3/users/442b8c10d77040f7a13303df2395b4ff` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:11.119661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] RBAC: Authorizing `identity:get_user(user_id=442b8c10d77040f7a13303df2395b4ff)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:11.121080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:11.122698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 439/876] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:51:10 2022] GET /identity/v3/users/442b8c10d77040f7a13303df2395b4ff => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:11.128416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:11.225526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d842e-5d84-40c1-9ba9-0f83a0180cb1 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:11.256859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:11.257972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:11.258250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:11.258522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:11.277617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:11.324359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:11.325809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:11.418870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 438/877] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:51:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:51:11.424684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:11.433898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:11.523681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1992e7-7e7b-4303-a785-1c621bf1049e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:11.555090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7764af-94a3-4b77-a1e7-1ba0641f75a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:11.555694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7764af-94a3-4b77-a1e7-1ba0641f75a2 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:11.555970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7764af-94a3-4b77-a1e7-1ba0641f75a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:11.556237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7764af-94a3-4b77-a1e7-1ba0641f75a2 None admin] PATH_INFO: `/v3/projects/febb40cf1967495297a1c41334e70fe9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:11.557321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7764af-94a3-4b77-a1e7-1ba0641f75a2 None admin] RBAC: Authorizing `identity:get_project(project_id=febb40cf1967495297a1c41334e70fe9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:11.558748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7764af-94a3-4b77-a1e7-1ba0641f75a2 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:11.560313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 440/878] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:51:11 2022] GET /identity/v3/projects/febb40cf1967495297a1c41334e70fe9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:11.566542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:11.613433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:11.661414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dab24-8e65-46d3-9215-60d14530c03c None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:11.693731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:11.694340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:11.695228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:11.695495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:11.696200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=febb40cf1967495297a1c41334e70fe9, user.id=442b8c10d77040f7a13303df2395b4ff) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:51:11.696500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:11.697924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b35c-92d4-4ab6-a2ec-31ee94ccb0be None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:11.703399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 439/879] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:51:11 2022] GET /identity/v3/role_assignments?user.id=442b8c10d77040f7a13303df2395b4ff&scope.project.id=febb40cf1967495297a1c41334e70fe9&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:13.848602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa3c40-2bc7-4467-aed0-52ee2bacf532 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:13.849126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa3c40-2bc7-4467-aed0-52ee2bacf532 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:13.849126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa3c40-2bc7-4467-aed0-52ee2bacf532 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:13.850515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 441/880] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:13.856561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aced3-a5b0-4828-a9a2-a22031aa6015 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:13.856973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aced3-a5b0-4828-a9a2-a22031aa6015 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:13.857110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aced3-a5b0-4828-a9a2-a22031aa6015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:13.875483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b38aced3-a5b0-4828-a9a2-a22031aa6015 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:13.876648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b38aced3-a5b0-4828-a9a2-a22031aa6015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:13.940475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 440/881] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:14.209344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa3c40-2bc7-4467-aed0-52ee2bacf532 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:14.282563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:14.307266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa3c40-2bc7-4467-aed0-52ee2bacf532 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:14.339174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7a267-2148-4e25-9f44-2dba934b1b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:14.339764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7a267-2148-4e25-9f44-2dba934b1b83 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:14.340049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7a267-2148-4e25-9f44-2dba934b1b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:14.340313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7a267-2148-4e25-9f44-2dba934b1b83 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:14.340976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7a267-2148-4e25-9f44-2dba934b1b83 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:14.342458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7a267-2148-4e25-9f44-2dba934b1b83 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:14.357554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 442/882] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Oct 20 05:51:14 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:51:16.511923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b821-7324-4227-b796-276116cfc7be None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:16.512499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b821-7324-4227-b796-276116cfc7be None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:16.512499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b821-7324-4227-b796-276116cfc7be None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:16.513796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 441/883] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:16.519299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:16.519702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:16.519843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:16.538289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:16.539602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:16.603157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 443/884] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:16.878734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089b821-7324-4227-b796-276116cfc7be None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:16.924520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:16.978290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089b821-7324-4227-b796-276116cfc7be None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:17.013268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe29fc6-6e6e-4821-bd35-d0200ea4ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:17.013917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe29fc6-6e6e-4821-bd35-d0200ea4ad3b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:17.014198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe29fc6-6e6e-4821-bd35-d0200ea4ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:17.014467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe29fc6-6e6e-4821-bd35-d0200ea4ad3b None admin] PATH_INFO: `/v3/domains/2130853fed3649afb208da3da084e81f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:17.025540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe29fc6-6e6e-4821-bd35-d0200ea4ad3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=2130853fed3649afb208da3da084e81f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:17.027015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe29fc6-6e6e-4821-bd35-d0200ea4ad3b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:17.028606 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 442/885] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Oct 20 05:51:16 2022] GET /identity/v3/domains/2130853fed3649afb208da3da084e81f => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:17.034453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:17.094350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:17.131320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd02eb-9e80-4ee6-a7fb-3cbff9c8c753 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:17.168096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07346d18-e577-4419-99fb-49653fcd03e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:17.168696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346d18-e577-4419-99fb-49653fcd03e5 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:17.168974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346d18-e577-4419-99fb-49653fcd03e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:17.169245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346d18-e577-4419-99fb-49653fcd03e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:17.169914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346d18-e577-4419-99fb-49653fcd03e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:17.171341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346d18-e577-4419-99fb-49653fcd03e5 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:17.201126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 444/886] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:51:17 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:51:19.339375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216d0c-7956-4282-830a-face7c3c0609 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:19.339923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216d0c-7956-4282-830a-face7c3c0609 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:19.339923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216d0c-7956-4282-830a-face7c3c0609 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:19.341252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 443/887] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:19.346516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:19.346934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:19.347061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:19.365162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:19.366383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:19.430353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 445/888] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:19.700029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8216d0c-7956-4282-830a-face7c3c0609 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:19.801901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8216d0c-7956-4282-830a-face7c3c0609 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:19.804667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:19.835322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69130-0f48-4a26-9cf9-ec396d0d2c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:19.836075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69130-0f48-4a26-9cf9-ec396d0d2c8e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:19.836346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69130-0f48-4a26-9cf9-ec396d0d2c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:19.836611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69130-0f48-4a26-9cf9-ec396d0d2c8e None admin] PATH_INFO: `/v3/domains/2130853fed3649afb208da3da084e81f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:19.837713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69130-0f48-4a26-9cf9-ec396d0d2c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=2130853fed3649afb208da3da084e81f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:19.839142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69130-0f48-4a26-9cf9-ec396d0d2c8e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:19.840669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 444/889] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Oct 20 05:51:19 2022] GET /identity/v3/domains/2130853fed3649afb208da3da084e81f => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:19.846469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:19.892955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:19.946012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac1f4-8937-4e99-95be-edb2b284ba45 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:19.979296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98dad-6d0c-43d6-966a-824909a32686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:19.979840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98dad-6d0c-43d6-966a-824909a32686 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:19.980119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98dad-6d0c-43d6-966a-824909a32686 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:19.980389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98dad-6d0c-43d6-966a-824909a32686 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:19.981029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98dad-6d0c-43d6-966a-824909a32686 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:19.982472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98dad-6d0c-43d6-966a-824909a32686 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:20.003549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 446/890] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:51:19 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:51:22.156646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518919c-bdce-4f95-8fb8-06f2b19ba935 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:22.157163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518919c-bdce-4f95-8fb8-06f2b19ba935 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:22.157163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518919c-bdce-4f95-8fb8-06f2b19ba935 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:22.158546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 445/891] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:22.164475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:22.164902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:22.165006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:22.182663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:22.183820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:22.247426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 447/892] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:22.517908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518919c-bdce-4f95-8fb8-06f2b19ba935 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:22.615539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518919c-bdce-4f95-8fb8-06f2b19ba935 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:22.650012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:22.650629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:22.650907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:22.651179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:22.660937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:51:22.665912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:51:22.667074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:51:22.668395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 446/893] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:51:22.672888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:22.702418 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:22.769793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac831b8-84ac-449e-b1ca-122ad4727271 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:22.803618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:22.804232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:22.804514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:22.804789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:22.805448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:51:22.805773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:22.807135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:22.814900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 448/894] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:22.821168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:22.852520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:22.921027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9fb4-aa67-4893-9859-a07c876c2f53 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:22.954934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:22.955544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:22.955819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:22.956086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] PATH_INFO: `/v3/users/15a7f09aa41f4382b13afcb30b945278` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:22.970050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] RBAC: Authorizing `identity:get_user(user_id=15a7f09aa41f4382b13afcb30b945278)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:22.971485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:22.973067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 447/895] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:51:22 2022] GET /identity/v3/users/15a7f09aa41f4382b13afcb30b945278 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:22.979457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:23.071058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:23.077918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8388-3787-4ae3-9536-f48e68f7699e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:23.110559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e7675-a078-4653-91dd-5cb9d3cb0f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:23.111172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7675-a078-4653-91dd-5cb9d3cb0f7b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:23.111449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7675-a078-4653-91dd-5cb9d3cb0f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:23.111719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7675-a078-4653-91dd-5cb9d3cb0f7b None admin] PATH_INFO: `/v3/projects/c9a23775a5454fd79bca9e8fc87b738e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:23.112811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e7675-a078-4653-91dd-5cb9d3cb0f7b None admin] RBAC: Authorizing `identity:get_project(project_id=c9a23775a5454fd79bca9e8fc87b738e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:23.114274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e7675-a078-4653-91dd-5cb9d3cb0f7b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:23.115872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 449/896] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:51:22 2022] GET /identity/v3/projects/c9a23775a5454fd79bca9e8fc87b738e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:23.121843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:23.208714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:23.219216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f89f-2619-41e2-97f1-7866d90720eb None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:23.251391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d611-4519-4005-81be-b2529c8a9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:23.252036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d611-4519-4005-81be-b2529c8a9a68 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:23.252316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d611-4519-4005-81be-b2529c8a9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:23.252589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d611-4519-4005-81be-b2529c8a9a68 None admin] PATH_INFO: `/v3/projects/c9a23775a5454fd79bca9e8fc87b738e/users/15a7f09aa41f4382b13afcb30b945278/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:23.254436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20d611-4519-4005-81be-b2529c8a9a68 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9a23775a5454fd79bca9e8fc87b738e, user_id=15a7f09aa41f4382b13afcb30b945278, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:23.255857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20d611-4519-4005-81be-b2529c8a9a68 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:23.268845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 448/897] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:51:23 2022] PUT /identity/v3/projects/c9a23775a5454fd79bca9e8fc87b738e/users/15a7f09aa41f4382b13afcb30b945278/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:51:25.393834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9aa66-3f7c-4e3f-870f-b5fa55c60964 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:25.394435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9aa66-3f7c-4e3f-870f-b5fa55c60964 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:25.394435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9aa66-3f7c-4e3f-870f-b5fa55c60964 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:25.395684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 450/898] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:51:25.401153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:25.401559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:25.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:25.419896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:51:25.421087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:51:25.484883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 449/899] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:51:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:51:25.754768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9aa66-3f7c-4e3f-870f-b5fa55c60964 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:25.852880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9aa66-3f7c-4e3f-870f-b5fa55c60964 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:25.884379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:25.884987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:25.885261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:25.885524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:25.895777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:51:25.901670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:51:25.902880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:51:25.903992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 451/900] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:51:25.910956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:25.989048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:26.008232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9b819-9780-4868-8c5a-7f702134bac1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:26.041683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:26.042301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:26.042580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:26.042848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:26.043504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:51:26.043803 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:26.045162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:26.052859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 450/901] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:26.058941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:26.082578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:26.156521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724ba3-d84d-4453-af14-ca0d0d98ce75 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:26.187973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:26.188575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:26.188850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:26.189119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] PATH_INFO: `/v3/users/15a7f09aa41f4382b13afcb30b945278` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:26.190228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] RBAC: Authorizing `identity:get_user(user_id=15a7f09aa41f4382b13afcb30b945278)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:26.191642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:26.193163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 452/902] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 05:51:26 2022] GET /identity/v3/users/15a7f09aa41f4382b13afcb30b945278 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:26.199565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:26.296565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc2bc-e4f6-4ede-a8f4-b547e692ff4e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:26.329166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:26.329776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:26.330061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:26.330333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:26.342306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:26.395797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:26.397854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:26.491747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 451/903] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:51:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:51:26.497573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:26.583371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:26.592491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67e7c-7d55-4741-a2a2-962c6bef6f3b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:26.623966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63988c3-e9a2-4670-9cd1-82633183ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:26.624572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63988c3-e9a2-4670-9cd1-82633183ae5a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:26.624845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63988c3-e9a2-4670-9cd1-82633183ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:26.625110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63988c3-e9a2-4670-9cd1-82633183ae5a None admin] PATH_INFO: `/v3/projects/c9a23775a5454fd79bca9e8fc87b738e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:26.626232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63988c3-e9a2-4670-9cd1-82633183ae5a None admin] RBAC: Authorizing `identity:get_project(project_id=c9a23775a5454fd79bca9e8fc87b738e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:26.627636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63988c3-e9a2-4670-9cd1-82633183ae5a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:26.629197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 453/904] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 05:51:26 2022] GET /identity/v3/projects/c9a23775a5454fd79bca9e8fc87b738e => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:51:26.636019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:51:26.677641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:26.732028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f2b59-bdd4-4095-ae61-604678799de9 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:51:26.763649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:51:26.764225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:51:26.764497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:51:26.764760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:51:26.765715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=c9a23775a5454fd79bca9e8fc87b738e, user.id=15a7f09aa41f4382b13afcb30b945278) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:51:26.766044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:51:26.767439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b94709-6afe-4d71-aa1d-0eb06f39f6d5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:51:26.773598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 452/905] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:51:26 2022] GET /identity/v3/role_assignments?user.id=15a7f09aa41f4382b13afcb30b945278&scope.project.id=c9a23775a5454fd79bca9e8fc87b738e&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:51:36.620051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=21 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:51:36.770378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=47 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:22.416887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e963d5-303a-487e-9dae-c053888d6285 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:22.416887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e963d5-303a-487e-9dae-c053888d6285 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:22.416887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e963d5-303a-487e-9dae-c053888d6285 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:22.418020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 454/906] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:22.423871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80264c82-5718-431d-86fc-668f5f193505 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:22.424343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80264c82-5718-431d-86fc-668f5f193505 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:22.424525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80264c82-5718-431d-86fc-668f5f193505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:22.444928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-80264c82-5718-431d-86fc-668f5f193505 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:22.446249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-80264c82-5718-431d-86fc-668f5f193505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:22.522937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 453/907] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:22.796120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e963d5-303a-487e-9dae-c053888d6285 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:22.942294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e963d5-303a-487e-9dae-c053888d6285 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:22.995698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:22.996851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:22.997208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:22.997529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:23.010115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:23.011968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:23.030201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:23.031552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:23.032695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:23.032695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:23.032695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:23.037811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 455/908] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:52:23.037976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80264c82-5718-431d-86fc-668f5f193505 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:23.169479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80264c82-5718-431d-86fc-668f5f193505 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:23.204568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:23.211322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:23.211987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:23.212343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:23.212642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:23.213391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:23.213685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:23.215051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab214-8a05-4ee3-bf2b-91e69fd6abe1 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:23.227910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 454/909] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:23.234121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:23.301044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:23.363501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bbdde-aba4-492b-b892-aefb33843ec8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:23.409154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4c7dc-a239-43a4-b83b-08b1441156ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:23.409756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4c7dc-a239-43a4-b83b-08b1441156ea None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:23.410071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4c7dc-a239-43a4-b83b-08b1441156ea None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:23.410390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4c7dc-a239-43a4-b83b-08b1441156ea None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:23.411934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4c7dc-a239-43a4-b83b-08b1441156ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:23.413374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4c7dc-a239-43a4-b83b-08b1441156ea None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:23.441851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 456/910] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 05:52:23 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:52:26.016149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0151a-f644-476f-b8f1-a0a0e322f877 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:26.016690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0151a-f644-476f-b8f1-a0a0e322f877 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:26.016690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0151a-f644-476f-b8f1-a0a0e322f877 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:26.018568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 455/911] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:26.025524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:26.026049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:26.026132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:26.048185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:26.049642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:26.143687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 457/912] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:26.447682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0151a-f644-476f-b8f1-a0a0e322f877 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:26.569621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0151a-f644-476f-b8f1-a0a0e322f877 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:26.608807 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:26.609472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:26.609765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:26.610052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:26.625767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:52:26.629178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:26.630910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:26.634711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 456/913] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:26.637241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:26.687412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:26.762726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b59-1d9b-4834-a081-e4a2d9a6cd88 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:26.805947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:26.806761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:26.807099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:26.807543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:26.808487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:26.808806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:26.812642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:26.821232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 458/914] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:52:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:26.828412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:26.884903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:26.944428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cfa14-3661-4182-9f4a-1aab4240f884 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:26.987817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:26.988493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:26.988763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:26.989153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:27.000381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:27.001925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:27.017630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:27.019340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:27.020890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:27.020890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:27.020890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:27.020890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 457/915] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:27.026521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:27.147953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:27.152758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5e91e-e22d-45df-a91a-494e3e5104b9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:27.193392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:27.194068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:27.194349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:27.194645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:27.195368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:27.195689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:27.197118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:27.217050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 459/916] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:27.217257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:27.331212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab748297-57ba-406b-964d-1eb439c01c11 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:27.333178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:27.374341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:27.375022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:27.375438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:27.375764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:27.384899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:27.386390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:52:27.399375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:27.400435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:27.401702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 458/917] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:27.406323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:27.515444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9609ab0-a575-4412-b758-49cb53622dd5 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:27.554634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:27.555276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:27.555612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:27.555871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:27.556633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:27.556925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:27.558486 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:27.577445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 460/918] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 05:52:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:52:27.583266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:27.698627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcdc1e-7d86-4a92-9647-83dced15b0ad None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:27.736613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:27.737538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:27.737887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:27.738156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:27.750034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:27.751485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:27.766966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:27.768114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:27.769385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:27.769385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:27.769385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:27.773891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 459/919] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:27.775237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:27.794347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:27.882551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c961d-11a3-44ca-b339-be7a87e4d39e None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:27.920966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:27.921632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:27.921944 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:27.922217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:27.922914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:27.923216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:27.924624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:27.936851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 461/920] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:27.942836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:27.960596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:28.061515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c4ed2-5786-4ba0-b7b5-d275c6d97d9a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:28.101345 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:28.102298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:28.102577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:28.102830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:28.109844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:28.111321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:52:28.125110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:28.126439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:28.127432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 460/921] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:28.141861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:28.245140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:28.270348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8724-3807-48ac-8cbd-d6c13dbcf355 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:28.308510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:28.309138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:28.309409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:28.309680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:28.310397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:28.310710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:28.312126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e6180-2396-45e8-ba38-52240509f7d9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:28.325725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 462/922] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:52:28.334809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:28.410316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:28.436655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50823f2-ffc4-41ee-8126-338b96639702 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:28.473046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65ff33-7038-4e4b-85c7-48285b605454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:28.473950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ff33-7038-4e4b-85c7-48285b605454 None admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:28.474371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ff33-7038-4e4b-85c7-48285b605454 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:28.474744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ff33-7038-4e4b-85c7-48285b605454 None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/d277333a752f4bfea444af9ed1a7a5bf/roles/ac9c50fabef745d89f0e8c2daa9ed2e3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:28.491106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65ff33-7038-4e4b-85c7-48285b605454 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=d277333a752f4bfea444af9ed1a7a5bf, role_id=ac9c50fabef745d89f0e8c2daa9ed2e3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:28.492455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65ff33-7038-4e4b-85c7-48285b605454 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:28.505230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 461/923] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:52:28 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/d277333a752f4bfea444af9ed1a7a5bf/roles/ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:52:30.644159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530020c6-ac33-4859-b2e9-bf33185c782f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:30.644749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530020c6-ac33-4859-b2e9-bf33185c782f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:30.644749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530020c6-ac33-4859-b2e9-bf33185c782f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:30.646269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 463/924] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:30.651868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:30.652320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:30.652413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:30.671227 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:30.672401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:30.747015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 462/925] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:31.015634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530020c6-ac33-4859-b2e9-bf33185c782f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:31.120112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530020c6-ac33-4859-b2e9-bf33185c782f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:31.154932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:31.155556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:31.155832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:31.156101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:31.163236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:31.167395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:52:31.172317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:31.173807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:31.174833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 464/926] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 05:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:31.179983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:31.244468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:31.291962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ec06-a278-4232-958e-58b48abcd8d1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:31.329401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:31.330038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:31.330312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:31.330623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:31.331238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:31.331537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:31.333084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:31.345103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 463/927] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 05:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:31.351789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:31.458776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad7b8-638d-4ec0-80d4-ef2be8bc2ec8 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:31.498882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:31.499431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:31.499680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:31.499945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:31.511334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:31.512753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:31.529094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:31.530357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:31.536761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:31.536761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:31.536761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:31.536761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 465/928] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:52:31.537671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:31.648284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701b17-a9f3-4b67-986e-4140ea6992ff None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:31.670735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:31.693165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:31.693892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:31.694244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:31.694588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:31.695370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:31.695679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:31.697240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:31.709409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 464/929] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:31.715496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:31.768789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:31.830274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d9c13-c97c-4d8c-bcae-8a2e25e174c9 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:31.871623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:31.872285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:31.872590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:31.872932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:31.882427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:31.884064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:52:31.896370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:31.897620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:31.898594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 466/930] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:31.903546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:32.012628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7e086-0739-44ac-a63d-3f52a72bbe97 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:32.046295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:32.046931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:32.047281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:32.047553 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:32.048280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:32.048593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:32.050114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:32.068669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 465/931] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 05:52:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:32.074541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:32.181997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707937-a2fa-4a23-be06-4b626fe02ac4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:32.193157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:32.219507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:32.220242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:32.220522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:32.220806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:32.293721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:32.295213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:32.414795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 467/932] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:52:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 05:52:32.420395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:32.454451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:32.532542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf32ca-5304-4424-aa77-82db0c106051 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:32.572230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:32.572976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:32.573355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:32.573694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:32.584839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:32.586359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:32.603840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:32.605068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:32.606556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:32.606556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:32.606556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:32.606556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 466/933] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:32.610872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:32.625797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:32.724465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a1ce-92eb-453b-b645-f7051ba075af None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:32.759296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:32.759968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:32.760296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:32.760615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:32.761329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:32.761638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:32.763275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:32.776265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 468/934] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:32.782383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:32.878356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:32.896622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cc0f-aba6-4167-b25f-225563e5da62 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:32.938693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:32.939358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:32.939692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:32.940088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:32.948143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:32.949760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:52:32.962188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:32.963249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:32.969312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 467/935] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:52:32.969938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:33.061817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:33.100037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac924ca5-e186-42a5-8fdd-f79e82de1ccc None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:33.136179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:33.136790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:33.137068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:33.137374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:33.138191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:33.138548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:33.140436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d76c0-0de4-4b93-a380-bb448d148402 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:33.154057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 469/936] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:52:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:33.160244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:33.273446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adf64b-e399-46e9-b869-cb49c182d4a6 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:33.309931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:33.310528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:33.310805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:33.311074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:33.311791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] RBAC: Adding query filter params (role.id=ac9c50fabef745d89f0e8c2daa9ed2e3, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=d277333a752f4bfea444af9ed1a7a5bf) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:33.312672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:33.313529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220ece6-1f6d-4995-8c9d-d229be2fc14d None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:33.320567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 468/937] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:52:33 2022] GET /identity/v3/role_assignments?user.id=d277333a752f4bfea444af9ed1a7a5bf&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=ac9c50fabef745d89f0e8c2daa9ed2e3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:35.547250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59272a2f-7ba1-42af-bc01-1add74d57769 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:35.547825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59272a2f-7ba1-42af-bc01-1add74d57769 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:35.547825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59272a2f-7ba1-42af-bc01-1add74d57769 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:35.549116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 470/938] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:35.556158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:35.556618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:35.556799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:35.575558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:35.576864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:35.580015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:35.654791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 469/939] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:52:35.951986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59272a2f-7ba1-42af-bc01-1add74d57769 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:36.071306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59272a2f-7ba1-42af-bc01-1add74d57769 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:36.102062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:36.108469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:36.109121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:36.109574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:36.109870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:36.121087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:52:36.126196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:36.127370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:52:36.128571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:36.132597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:36.133517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:36.249462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661161d-1f33-4d58-bd2c-54ebd402deca None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:36.290760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:36.291477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:36.291827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:36.292106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:36.292852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:36.293226 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:36.294645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:36.304374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:36.310254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:36.424437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdad9e-903f-4685-8635-049c7751af0b None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:36.465071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:36.465707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:36.466022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:36.466298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:36.477655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:36.479240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:36.495241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:36.496436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:36.497328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:36.497328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:36.497328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:36.497328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 472/942] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:36.502515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:36.506545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:36.618319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739a62-4be3-4637-b492-197b170d62cc None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:36.659249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:36.660020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:36.660417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:36.660825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:36.661920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:36.662338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:36.664119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:36.680224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 471/943] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:36.686470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:36.739546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:36.805918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b39ba-5b60-4d55-b0c1-14390952f561 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:36.841368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:36.842033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:36.842313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:36.842585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:36.851932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:36.853521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:52:36.865538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:36.867022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:36.868108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 473/944] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:52:36.873041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:36.943577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:36.987017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff14581-6e83-4dc0-ac69-5e27fa29336f None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:37.026048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:37.026674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:37.026972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:37.027341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:37.028068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:37.028401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:37.029943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:37.049810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 472/945] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 05:52:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:37.056253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:37.167480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa278fa6-0395-4c58-a706-e782d0e274c0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:37.169142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:37.205070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:37.205916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:37.206307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:37.206678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:37.218932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:37.220371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:37.237977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:37.239027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:37.239961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:37.239961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:37.239961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:37.239961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 474/946] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 05:52:37.245953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:37.354388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035892-f341-4e8f-a087-e020b8be076e None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:37.375218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:37.393150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:37.393843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:37.394157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:37.394434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:37.395594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:37.395914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:37.397459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:37.415212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 473/947] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:37.416386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:37.525306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9000c-7c5b-4ab1-aeb4-0f99f39df279 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:37.560819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:37.561496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:37.561809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:37.562141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:37.569625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:37.571295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:52:37.584846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:37.585952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:37.586956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 475/948] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:37.592179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:37.719994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e245cb-a8f4-4831-acef-e29960c272fd None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:37.759240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:37.759854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:37.760176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:37.760527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:37.761254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:37.761540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:37.763010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3e9b8-7998-4531-a9f0-4e8c6fe14403 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:37.776428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 474/949] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:52:37.782496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:37.799448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:37.899129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91181b5-0056-4528-b9ff-125a73f36fcf None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:37.937830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63186348-34c7-412a-ae3a-72c8f045e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:37.938800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63186348-34c7-412a-ae3a-72c8f045e85f None admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:37.939084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63186348-34c7-412a-ae3a-72c8f045e85f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:37.939358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63186348-34c7-412a-ae3a-72c8f045e85f None admin] PATH_INFO: `/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/d277333a752f4bfea444af9ed1a7a5bf/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:37.941524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63186348-34c7-412a-ae3a-72c8f045e85f None admin] RBAC: Authorizing `identity:create_grant(project_id=2849c247210d4893bfbaba6bbc95e8f3, user_id=d277333a752f4bfea444af9ed1a7a5bf, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:37.943498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63186348-34c7-412a-ae3a-72c8f045e85f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:37.959272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 476/950] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 05:52:37 2022] PUT /identity/v3/projects/2849c247210d4893bfbaba6bbc95e8f3/users/d277333a752f4bfea444af9ed1a7a5bf/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 05:52:40.308399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546c7f-75b1-4703-b764-3aa61e43acf9 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:40.308937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546c7f-75b1-4703-b764-3aa61e43acf9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:40.308937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546c7f-75b1-4703-b764-3aa61e43acf9 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:40.312846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 475/951] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:52:40.315573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:40.315991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:40.316127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:40.336503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:40.337614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:40.407606 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 477/952] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:40.704102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546c7f-75b1-4703-b764-3aa61e43acf9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:40.752744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:40.821599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546c7f-75b1-4703-b764-3aa61e43acf9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:40.862460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:40.863258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:40.863570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:40.863888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:40.875289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 05:52:40.880891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:40.881899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:40.882879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 476/953] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 05:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:40.889083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:40.892811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:40.998797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c1c4-769e-4db7-8194-5c033c1556a2 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:41.034992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:41.035728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:41.036098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:41.036373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:41.037033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:41.037336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:41.038725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:41.046565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 478/954] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 05:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:41.053074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:41.158111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:41.161356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3e44b-3c57-45aa-91ee-36d58f49d831 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:41.199219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:41.199851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:41.200130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:41.200403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:41.212557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:41.214021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:41.228354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:41.229464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:41.230888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:41.230888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:41.230888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:41.230888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 477/955] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:41.235502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:41.312081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:41.349573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45a4a4-90d6-4a14-a3ee-3cb4019a554f None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:41.387251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:41.387855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:41.388129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:41.388394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:41.389049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:41.389345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:41.390975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:41.404591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 479/956] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:52:41.411325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:41.516470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d701f-413b-4042-8448-2ccac2e45b4a None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:41.552473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:41.553105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:41.553383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:41.553657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:41.561901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:41.563562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 05:52:41.576791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:41.577947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 05:52:41.579105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:41.584263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 478/957] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:41.586124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:41.709634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f64e1-144c-497b-a947-d4ca97cb14ad None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:41.736645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:41.747689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:41.748349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:41.748638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:41.748907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:41.749734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:41.750061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:41.751535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:41.772634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 480/958] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 05:52:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:41.779532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:41.796451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:41.890353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b92d7-8592-4dda-97ea-3f455f89c756 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:41.926936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:41.927626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:41.927921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:41.928258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:42.013136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:42.014658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:42.030365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:42.121213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 479/959] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 05:52:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 05:52:42.127284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:42.233488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c3d61-80d5-46a4-9693-0f97c4b800a4 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:42.268832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:42.269474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:42.270391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:42.270677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:42.281865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:42.283262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 05:52:42.299076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:42.300235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 05:52:42.301345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 05:52:42.301345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 05:52:42.301345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:42.301345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 481/960] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:42.306518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:42.409849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5e98-5239-4764-9ea1-608490e469cb None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:42.424523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:42.446940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:42.447541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:42.447818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:42.448090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:42.448727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:42.449027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:42.450454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:42.461689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 480/961] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 05:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:42.467565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:42.502641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:42.570150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a940c-081e-403c-af24-af7ec4d1bdd6 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:42.603685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:42.604304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:42.604578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:42.604845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:42.611442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:42.612878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 05:52:42.624527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:42.625572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: ERROR keystone.server.flask.application Oct 20 05:52:42.626641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 482/962] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 05:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:42.631682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:42.744669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77924612-f93c-42b6-987a-0cb03454f683 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:42.776612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:42.777199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:42.777470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:42.777766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:42.778438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:42.778734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:42.780139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e67ef-ccba-4cd1-82e9-781d997b1649 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:42.792440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 481/963] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 05:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:42.798902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:42.888507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:42.896161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6a85-27c3-4c4a-a9c7-b803179db276 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:42.929116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:42.929711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:42.930020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:42.930289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:42.931006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] RBAC: Adding query filter params (role.id=987cfd6c90bf4abf93e401eacbd51c60, scope.project.id=2849c247210d4893bfbaba6bbc95e8f3, user.id=d277333a752f4bfea444af9ed1a7a5bf) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:42.931314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:42.932717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310060c8-2626-4eb1-a814-62ca94846e63 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:42.938298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 483/964] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 05:52:42 2022] GET /identity/v3/role_assignments?user.id=d277333a752f4bfea444af9ed1a7a5bf&scope.project.id=2849c247210d4893bfbaba6bbc95e8f3&role.id=987cfd6c90bf4abf93e401eacbd51c60 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:45.074130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5ef80-7abd-4fd6-b599-002f740e8fbd None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:45.074656 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5ef80-7abd-4fd6-b599-002f740e8fbd None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:45.074656 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5ef80-7abd-4fd6-b599-002f740e8fbd None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:45.075994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 482/965] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:45.081199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:45.081652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:45.081973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:45.102712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:45.103929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:45.182889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 484/966] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 05:52:45.473374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5ef80-7abd-4fd6-b599-002f740e8fbd None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:45.505849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:45.581391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5ef80-7abd-4fd6-b599-002f740e8fbd None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:45.617498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:45.618231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:45.618786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:45.619058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:45.619629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:45.620984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:45.630698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:45.632179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:45.633411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 483/967] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:52:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:45.641255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:45.748133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:45.758200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88ed2-522a-4ca1-ad05-7ef194cd103b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:45.790579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:45.791183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:45.791462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:45.791735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:45.792360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:45.792665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:45.794061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69a447-357d-4b0e-a119-f597fb3c0e0a None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:45.798695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 485/968] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 05:52:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 05:52:45.805020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:45.897586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:45.903885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d7ab3-92ee-4a56-a07d-7cca97afe3eb None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:45.936836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:45.937481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:45.937779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:45.938057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] PATH_INFO: `/v3/services` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:45.938680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:45.938981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:45.940344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaad790-202b-496f-922b-44194a1833a8 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:45.945261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 484/969] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 05:52:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:48.071721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f05ea-2fb0-42b1-8b64-1ecd25a2e24c None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:48.072280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f05ea-2fb0-42b1-8b64-1ecd25a2e24c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:48.072280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f05ea-2fb0-42b1-8b64-1ecd25a2e24c None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:48.073572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 486/970] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:48.078681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e3a0-cc40-446b-80d6-5bd559bdb3a2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:48.079071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e3a0-cc40-446b-80d6-5bd559bdb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:48.079229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e3a0-cc40-446b-80d6-5bd559bdb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:48.097381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-bb29e3a0-cc40-446b-80d6-5bd559bdb3a2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:48.099277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-bb29e3a0-cc40-446b-80d6-5bd559bdb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:48.163530 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 485/971] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:48.430246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f05ea-2fb0-42b1-8b64-1ecd25a2e24c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:48.527134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f05ea-2fb0-42b1-8b64-1ecd25a2e24c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:48.558834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5956b8b-66f6-406f-8a1a-fc6a71aa3895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:48.559415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5956b8b-66f6-406f-8a1a-fc6a71aa3895 None admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:48.559689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5956b8b-66f6-406f-8a1a-fc6a71aa3895 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:48.559956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5956b8b-66f6-406f-8a1a-fc6a71aa3895 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:48.560596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5956b8b-66f6-406f-8a1a-fc6a71aa3895 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:48.561975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5956b8b-66f6-406f-8a1a-fc6a71aa3895 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:48.576165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 487/972] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 05:52:48 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:52:50.780951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364f90-33bc-42b7-ba3e-466ccb6f0230 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:50.781509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364f90-33bc-42b7-ba3e-466ccb6f0230 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:50.781509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364f90-33bc-42b7-ba3e-466ccb6f0230 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:50.782837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 486/973] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:50.788388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:50.788825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:50.788925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:50.806571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:50.807729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:50.817204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:50.880366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 488/974] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:51.148938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364f90-33bc-42b7-ba3e-466ccb6f0230 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:51.237072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:51.248016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364f90-33bc-42b7-ba3e-466ccb6f0230 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:51.281716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:51.282353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:51.282634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:51.282904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:51.283479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:51.284891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:51.293564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:51.294847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:51.295764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 487/975] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:52:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:51.300724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:51.397401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee00e78-c284-4325-a19d-a0bcb9fb0ad6 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:51.429290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:51.429859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:51.430139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:51.430413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:51.431035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:51.431339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:51.432695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:51.437618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 489/976] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 05:52:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:51.444180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:51.541859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b66f-47e3-4726-9245-29a9b024dfa5 None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:51.574927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:51.575516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:51.575794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:51.576065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:51.576750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] RBAC: Adding query filter params (interface=public, service_id=3d4024f601384c9c8da39bb7a8e412f3, region_id=RegionOne) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:51.577054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:51.578705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6af3-f566-4fbf-9cfa-406eab12d183 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:51.584531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 488/977] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 05:52:51 2022] GET /identity/v3/endpoints?service_id=3d4024f601384c9c8da39bb7a8e412f3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:51.590112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:51.593727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:51.696071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ed54b-582a-4bbd-913b-51e01dd97bb0 None admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:51.731302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aa4d6-c50a-4fdd-be2f-8d67e141379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:51.731897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa4d6-c50a-4fdd-be2f-8d67e141379b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:51.732172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa4d6-c50a-4fdd-be2f-8d67e141379b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:51.732440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa4d6-c50a-4fdd-be2f-8d67e141379b None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:51.733031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417aa4d6-c50a-4fdd-be2f-8d67e141379b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:51.734408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417aa4d6-c50a-4fdd-be2f-8d67e141379b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:51.741501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 490/978] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 05:52:51 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:52:53.877634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9a320-4110-4a20-9c55-dbdede770e60 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:53.878213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9a320-4110-4a20-9c55-dbdede770e60 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:53.878213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9a320-4110-4a20-9c55-dbdede770e60 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:53.879562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 489/979] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:52:53.884752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:53.885175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:53.885269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:53.903568 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:52:53.904756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:52:53.964023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:53.969782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 491/980] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:52:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 05:52:54.236796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9a320-4110-4a20-9c55-dbdede770e60 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:54.256103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:54.334910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9a320-4110-4a20-9c55-dbdede770e60 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:54.367524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:54.368139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:54.368413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:54.368681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:54.369247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:54.370618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 05:52:54.378963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 05:52:54.380281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application with Lock( Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self._enter() Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application return self.creator() Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application created_value = creator( Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: ERROR keystone.server.flask.application Oct 20 05:52:54.381448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 490/981] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 05:52:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 05:52:54.386194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:54.480890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a7af4-6db8-402f-b9be-1a34093c3487 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:54.513214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:54.513769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:54.514040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:54.514307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] PATH_INFO: `/v3/services` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:54.515170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:52:54.515471 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:54.516805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e47b-3139-48ed-a050-91afd0f3d95b None admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:54.521666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 492/982] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 05:52:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:52:54.527301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:52:54.605350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:52:54.623423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f378-62aa-4b18-8316-6b52545b022b None admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:52:54.662818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa3924-2c26-41e7-b11a-ae1f70a74ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:52:54.663706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3924-2c26-41e7-b11a-ae1f70a74ee0 None admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:52:54.664069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3924-2c26-41e7-b11a-ae1f70a74ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:52:54.664515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3924-2c26-41e7-b11a-ae1f70a74ee0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:52:54.665393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa3924-2c26-41e7-b11a-ae1f70a74ee0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:52:54.667110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa3924-2c26-41e7-b11a-ae1f70a74ee0 None admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:52:54.690381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 491/983] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:52:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:53:04.519318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=69 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:53:04.686295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:53:58.219554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018025-88a2-4bd9-9e4b-6d7bf726996b None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:53:58.220519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018025-88a2-4bd9-9e4b-6d7bf726996b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:53:58.220732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018025-88a2-4bd9-9e4b-6d7bf726996b None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:53:58.230887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab116e6c-26f0-4308-b306-cb322c83904a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:53:58.231319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab116e6c-26f0-4308-b306-cb322c83904a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:53:58.231826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab116e6c-26f0-4308-b306-cb322c83904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:53:58.234786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 493/984] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:53:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:53:58.387338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ab116e6c-26f0-4308-b306-cb322c83904a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:53:58.388470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ab116e6c-26f0-4308-b306-cb322c83904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:53:58.521945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 492/985] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:53:58.817734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58419c6-015d-425a-83bc-be42e9c277aa None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:53:58.818168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58419c6-015d-425a-83bc-be42e9c277aa None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:53:58.818545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58419c6-015d-425a-83bc-be42e9c277aa None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:53:58.820038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 494/986] 10.222.0.16 () {54 vars in 964 bytes} [Thu Oct 20 05:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:53:58.825914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06266a-19b3-4bfd-877b-4b4a02b99a6b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:53:58.826292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06266a-19b3-4bfd-877b-4b4a02b99a6b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:53:58.826745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06266a-19b3-4bfd-877b-4b4a02b99a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:53:58.907161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ae06266a-19b3-4bfd-877b-4b4a02b99a6b None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:53:58.908497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ae06266a-19b3-4bfd-877b-4b4a02b99a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:53:58.932787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:53:58.996811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 493/987] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Oct 20 05:53:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:53:59.006651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58419c6-015d-425a-83bc-be42e9c277aa None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:53:59.008445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d58419c6-015d-425a-83bc-be42e9c277aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:53:59.132854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58419c6-015d-425a-83bc-be42e9c277aa None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:53:59.216502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:53:59.217480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:53:59.217989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:53:59.218489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:53:59.220424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:53:59.285955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:53:59.358563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:53:59.360779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13027b-f662-4fec-8281-61f2fb935726 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:53:59.381891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 495/988] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 05:54:01.872038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1482c5-8e7a-4335-84bc-0d8efff5d868 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:01.872528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1482c5-8e7a-4335-84bc-0d8efff5d868 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:01.872619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1482c5-8e7a-4335-84bc-0d8efff5d868 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:01.873947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 494/989] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:01.879641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c69156-6f76-466a-8977-3371def3f210 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:01.880051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c69156-6f76-466a-8977-3371def3f210 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:01.880187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c69156-6f76-466a-8977-3371def3f210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:01.963151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-63c69156-6f76-466a-8977-3371def3f210 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:01.964354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-63c69156-6f76-466a-8977-3371def3f210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:02.060031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 496/990] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:02.352812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1482c5-8e7a-4335-84bc-0d8efff5d868 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:02.354400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1a1482c5-8e7a-4335-84bc-0d8efff5d868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:02.456804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1482c5-8e7a-4335-84bc-0d8efff5d868 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:02.527597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:02.529993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:02.530805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:02.531127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:02.531566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:02.533388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:02.638589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:02.640180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3e2ec-bbff-46d8-bd99-ed31d7c67aba service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:02.658390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 495/991] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:05.076372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9407dbb-5c2e-456e-8f2a-f6fd9d865205 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:05.076883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9407dbb-5c2e-456e-8f2a-f6fd9d865205 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:05.076883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9407dbb-5c2e-456e-8f2a-f6fd9d865205 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:05.078268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 497/992] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:05.084011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed593f-4bdd-481e-8578-21da067bade8 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:05.084424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed593f-4bdd-481e-8578-21da067bade8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:05.084595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed593f-4bdd-481e-8578-21da067bade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:05.150910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-16ed593f-4bdd-481e-8578-21da067bade8 None None] MFA Rules not processed for user `ce00856f249a4350b173240c06edfe65`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:05.152101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-16ed593f-4bdd-481e-8578-21da067bade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:05.203016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:05.247159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 496/993] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:05.530874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9407dbb-5c2e-456e-8f2a-f6fd9d865205 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:05.533109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b9407dbb-5c2e-456e-8f2a-f6fd9d865205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:05.542765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:05.636625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9407dbb-5c2e-456e-8f2a-f6fd9d865205 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:05.710207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:05.710800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:05.711073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:05.711337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:05.712956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:05.773874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:05.820147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:05.821578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5d1fc-bfd1-4a7a-ad99-7596bac266db service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:05.840049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 498/994] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:08.571920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4bcf8-f324-41df-8507-4401dd598d39 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:08.572495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4bcf8-f324-41df-8507-4401dd598d39 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:08.572495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4bcf8-f324-41df-8507-4401dd598d39 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:08.573805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 497/995] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:08.579151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dbcb-a9c1-49b8-a09f-1a216f6a80d7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:08.579524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dbcb-a9c1-49b8-a09f-1a216f6a80d7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:08.579693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dbcb-a9c1-49b8-a09f-1a216f6a80d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:08.645044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9177dbcb-a9c1-49b8-a09f-1a216f6a80d7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:08.646259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9177dbcb-a9c1-49b8-a09f-1a216f6a80d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:08.741947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 499/996] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:09.044746 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd2d4e-25eb-48f7-b658-418423ab747d None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:09.045027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd2d4e-25eb-48f7-b658-418423ab747d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:09.045304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd2d4e-25eb-48f7-b658-418423ab747d None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:09.046671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 498/997] 10.222.0.16 () {54 vars in 964 bytes} [Thu Oct 20 05:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:09.052773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279e04-33d1-48c7-a81b-d2ac0bbf72e0 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:09.053054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279e04-33d1-48c7-a81b-d2ac0bbf72e0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:09.053327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279e04-33d1-48c7-a81b-d2ac0bbf72e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:09.074966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:09.128150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e7279e04-33d1-48c7-a81b-d2ac0bbf72e0 None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:09.129332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e7279e04-33d1-48c7-a81b-d2ac0bbf72e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:09.201948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 500/998] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Oct 20 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:09.211410 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd2d4e-25eb-48f7-b658-418423ab747d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:09.212926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-06cd2d4e-25eb-48f7-b658-418423ab747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:09.314597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd2d4e-25eb-48f7-b658-418423ab747d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:09.385956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:09.386551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:09.386824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:09.387090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:09.388667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:09.396267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:09.495343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:09.496795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f695ba-44b3-4c03-9055-436afec5b0d8 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:09.515195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 499/999] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:12.772444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b346d-1d3b-42cf-a629-dff7cfb04740 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:12.772986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b346d-1d3b-42cf-a629-dff7cfb04740 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:12.772986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b346d-1d3b-42cf-a629-dff7cfb04740 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:12.774512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 501/1000] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:12.780354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207aad-6e14-451a-9adc-74d1fa4a0acc None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:12.780867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207aad-6e14-451a-9adc-74d1fa4a0acc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:12.780867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207aad-6e14-451a-9adc-74d1fa4a0acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:12.860113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-96207aad-6e14-451a-9adc-74d1fa4a0acc None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:12.861329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-96207aad-6e14-451a-9adc-74d1fa4a0acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:12.923092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:12.965493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 500/1001] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:13.252230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b346d-1d3b-42cf-a629-dff7cfb04740 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:13.253800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c33b346d-1d3b-42cf-a629-dff7cfb04740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:13.362134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b346d-1d3b-42cf-a629-dff7cfb04740 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:13.373866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:13.435382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:13.435979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:13.436250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:13.436514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:13.438721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:13.546750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:13.548617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b872b-5030-4759-a885-0d9ebc67f6b9 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:13.566952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 502/1002] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:15.787533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad471-8952-48cd-a002-34eb72b7da6b None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:15.788025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad471-8952-48cd-a002-34eb72b7da6b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:15.788111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad471-8952-48cd-a002-34eb72b7da6b None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:15.789488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 501/1003] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:15.795810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865091c2-66b4-4ff5-9d2d-5a6542e0633d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:15.796276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865091c2-66b4-4ff5-9d2d-5a6542e0633d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:15.796384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865091c2-66b4-4ff5-9d2d-5a6542e0633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:15.846666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:15.866153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-865091c2-66b4-4ff5-9d2d-5a6542e0633d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:15.867278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-865091c2-66b4-4ff5-9d2d-5a6542e0633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:15.976117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 503/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:54:16.258246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ad471-8952-48cd-a002-34eb72b7da6b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:16.259768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a31ad471-8952-48cd-a002-34eb72b7da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:16.373827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ad471-8952-48cd-a002-34eb72b7da6b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:16.454572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:16.455173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:16.455444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:16.455712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:16.457277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:16.474435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:16.570382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:16.571806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d397802-600c-466b-a4b9-0becbac293c9 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:16.589361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 502/1005] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 05:54:18.809576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afafb2-0f38-4bf0-b8e5-28dd8d40ad6f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:18.810116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afafb2-0f38-4bf0-b8e5-28dd8d40ad6f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:18.810236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afafb2-0f38-4bf0-b8e5-28dd8d40ad6f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:18.811504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 504/1006] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:18.817707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d9c9-43e1-45dd-9910-ed4cb8cb0d7d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:18.818246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d9c9-43e1-45dd-9910-ed4cb8cb0d7d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:18.818324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d9c9-43e1-45dd-9910-ed4cb8cb0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:18.885233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4054d9c9-43e1-45dd-9910-ed4cb8cb0d7d None None] MFA Rules not processed for user `ce00856f249a4350b173240c06edfe65`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:18.886392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4054d9c9-43e1-45dd-9910-ed4cb8cb0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:18.951387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:18.983937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 503/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:19.265771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afafb2-0f38-4bf0-b8e5-28dd8d40ad6f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:19.267129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-86afafb2-0f38-4bf0-b8e5-28dd8d40ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:19.369676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afafb2-0f38-4bf0-b8e5-28dd8d40ad6f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:19.390224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:19.444869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:19.445476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:19.445772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:19.446047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:19.447632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:19.559459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:19.560896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da1039-393c-4e4b-995f-f44cbbbcb9de service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:19.580613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 505/1008] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:21.954030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57ab39-864a-4c53-b35d-c632052552fc None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:21.954603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57ab39-864a-4c53-b35d-c632052552fc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:21.954603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57ab39-864a-4c53-b35d-c632052552fc None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:21.955783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 504/1009] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:21.960968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064fad5-98e6-4c00-863e-edf76462e35e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:21.961424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064fad5-98e6-4c00-863e-edf76462e35e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:21.961515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064fad5-98e6-4c00-863e-edf76462e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:22.024953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:22.027987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-6064fad5-98e6-4c00-863e-edf76462e35e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:22.029617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6064fad5-98e6-4c00-863e-edf76462e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:22.123704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 506/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:22.407702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57ab39-864a-4c53-b35d-c632052552fc None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:22.409244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dc57ab39-864a-4c53-b35d-c632052552fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:22.510523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57ab39-864a-4c53-b35d-c632052552fc None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:22.583516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:22.584118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:22.584398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:22.584668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:22.586315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:22.613059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:22.694148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:22.695509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8037db0-b7a3-400e-a4e3-369b3ee249d5 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:22.713070 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 505/1011] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:24.904348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc73c-be40-49c5-b514-2ea0bf345d18 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:24.904949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc73c-be40-49c5-b514-2ea0bf345d18 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:24.904949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc73c-be40-49c5-b514-2ea0bf345d18 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:24.906304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 507/1012] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:24.912188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0955e-c5bc-4b17-bdf9-7b1beb997e8b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:24.912676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0955e-c5bc-4b17-bdf9-7b1beb997e8b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:24.912780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0955e-c5bc-4b17-bdf9-7b1beb997e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:24.981645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ecb0955e-c5bc-4b17-bdf9-7b1beb997e8b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:24.982881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ecb0955e-c5bc-4b17-bdf9-7b1beb997e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:25.056704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:25.081351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 506/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:25.371914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fc73c-be40-49c5-b514-2ea0bf345d18 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:25.373446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9e6fc73c-be40-49c5-b514-2ea0bf345d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:25.477414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fc73c-be40-49c5-b514-2ea0bf345d18 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:25.506186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:25.551407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:25.552003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:25.552281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:25.552551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:25.554218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:25.664543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:25.665928 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75395a-7a2c-46a2-afad-8ee9fc9d56fe service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:25.684253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 508/1014] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:28.127533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bc9ca-c3d5-4d05-81e6-36b215f67163 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:28.128083 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bc9ca-c3d5-4d05-81e6-36b215f67163 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:28.128083 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bc9ca-c3d5-4d05-81e6-36b215f67163 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:28.129385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 507/1015] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:28.134459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af22b5-1272-4404-9159-3be8c11b422c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:28.134858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af22b5-1272-4404-9159-3be8c11b422c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:28.134996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af22b5-1272-4404-9159-3be8c11b422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:28.201240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-63af22b5-1272-4404-9159-3be8c11b422c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:28.202470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-63af22b5-1272-4404-9159-3be8c11b422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:28.210567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:28.299558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 509/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:28.585245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bc9ca-c3d5-4d05-81e6-36b215f67163 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:28.586813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d87bc9ca-c3d5-4d05-81e6-36b215f67163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:28.691455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bc9ca-c3d5-4d05-81e6-36b215f67163 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:28.762127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:28.762644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:28.762915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:28.763180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:28.764991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:28.800475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:28.874024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:28.875736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cc3d1-0e25-43f6-bd3e-f40d557afd2f service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:28.893151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 508/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:33.096540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450021a-fa3d-46cb-91d4-793d695f72ea None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:33.097063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450021a-fa3d-46cb-91d4-793d695f72ea None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:33.097063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450021a-fa3d-46cb-91d4-793d695f72ea None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:33.098601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 510/1018] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:33.103773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24b92-da41-4c11-a14c-ad2fc1b15244 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:33.104272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24b92-da41-4c11-a14c-ad2fc1b15244 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:33.104364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24b92-da41-4c11-a14c-ad2fc1b15244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:33.172193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2fc24b92-da41-4c11-a14c-ad2fc1b15244 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:33.173323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2fc24b92-da41-4c11-a14c-ad2fc1b15244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:33.259584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:33.271745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 509/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:33.563298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450021a-fa3d-46cb-91d4-793d695f72ea None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:33.564827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2450021a-fa3d-46cb-91d4-793d695f72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:33.667762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450021a-fa3d-46cb-91d4-793d695f72ea None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:33.705543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:33.741128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:33.741728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:33.742033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:33.742302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:33.743877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:33.853517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:33.854927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de0fe2-285d-4dff-a33e-96fe5cee0237 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:33.874104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 511/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:36.676012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2b1ec-99f3-4259-9f90-8a6c6db5bcb9 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:36.676603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2b1ec-99f3-4259-9f90-8a6c6db5bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:36.676603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2b1ec-99f3-4259-9f90-8a6c6db5bcb9 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:36.677954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 510/1021] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:36.683185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eabe0-de13-4840-ba47-e48900ca884f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:36.683608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eabe0-de13-4840-ba47-e48900ca884f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:36.683716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eabe0-de13-4840-ba47-e48900ca884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:36.748757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e85eabe0-de13-4840-ba47-e48900ca884f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:36.750699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e85eabe0-de13-4840-ba47-e48900ca884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:36.769101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:36.848520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 512/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:54:37.137394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2b1ec-99f3-4259-9f90-8a6c6db5bcb9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:37.139298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-05d2b1ec-99f3-4259-9f90-8a6c6db5bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:37.252086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2b1ec-99f3-4259-9f90-8a6c6db5bcb9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:37.325897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:37.326494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:37.326764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:37.327030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:37.329085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:37.372377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:37.439782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:37.441221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f1325-f17e-4474-b344-304f855f6c24 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:37.461022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 511/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:41.850413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5709-bfa8-4149-aaac-885939d62ba0 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:41.850981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5709-bfa8-4149-aaac-885939d62ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:41.851078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5709-bfa8-4149-aaac-885939d62ba0 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:41.852407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 513/1024] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:41.857787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd274d1-b001-4120-80ba-3f52559df866 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:41.858212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd274d1-b001-4120-80ba-3f52559df866 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:41.858344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd274d1-b001-4120-80ba-3f52559df866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:41.933265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6bd274d1-b001-4120-80ba-3f52559df866 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:41.934550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6bd274d1-b001-4120-80ba-3f52559df866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:42.044095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:42.053768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 512/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:54:42.327905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e5709-bfa8-4149-aaac-885939d62ba0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:42.329479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-409e5709-bfa8-4149-aaac-885939d62ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:42.432210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e5709-bfa8-4149-aaac-885939d62ba0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:42.480890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:42.506072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:42.506672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:42.506946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:42.507211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:42.508769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:42.615144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:42.616470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e56751-cafd-4c21-b001-8218802f7580 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:42.634744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 514/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:54:47.663591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f793b6-74db-420a-8cd6-0aa049ca34db None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:47.664077 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f793b6-74db-420a-8cd6-0aa049ca34db None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:47.664077 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f793b6-74db-420a-8cd6-0aa049ca34db None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:47.683566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866fabc-bff2-43ad-aeaa-06179eaf1942 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:47.684080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866fabc-bff2-43ad-aeaa-06179eaf1942 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:47.684175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866fabc-bff2-43ad-aeaa-06179eaf1942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:47.694082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 513/1027] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 05:54:47 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:47.782277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b866fabc-bff2-43ad-aeaa-06179eaf1942 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:47.783578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b866fabc-bff2-43ad-aeaa-06179eaf1942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:47.803962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:47.901975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 515/1028] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 05:54:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:52.003199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246bf24-fba2-4c34-8147-ce572475fa91 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:52.003704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246bf24-fba2-4c34-8147-ce572475fa91 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:52.003787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246bf24-fba2-4c34-8147-ce572475fa91 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:52.005198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 514/1029] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 05:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:52.010228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb39fa-36a1-4c82-ae9d-9db30aaca376 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:52.010652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb39fa-36a1-4c82-ae9d-9db30aaca376 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:52.010781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb39fa-36a1-4c82-ae9d-9db30aaca376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:52.094060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b7cb39fa-36a1-4c82-ae9d-9db30aaca376 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:52.095275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b7cb39fa-36a1-4c82-ae9d-9db30aaca376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:52.169595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:52.210848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 516/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 05:54:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:54:53.536593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98202f0-e458-4302-9250-97c0fd4be8d3 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:53.537122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98202f0-e458-4302-9250-97c0fd4be8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:53.537122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98202f0-e458-4302-9250-97c0fd4be8d3 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:53.538484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 515/1031] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 05:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:53.543586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6089b-52bc-4f9c-b535-9c21b0b3b582 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:53.544004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6089b-52bc-4f9c-b535-9c21b0b3b582 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:53.544293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6089b-52bc-4f9c-b535-9c21b0b3b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:53.620129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8ad6089b-52bc-4f9c-b535-9c21b0b3b582 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:53.621307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8ad6089b-52bc-4f9c-b535-9c21b0b3b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:53.725571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 517/1032] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 05:54:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:54:57.313816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7426-5a46-4bd2-97c3-87e74235bf21 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:57.314419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7426-5a46-4bd2-97c3-87e74235bf21 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:57.314419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7426-5a46-4bd2-97c3-87e74235bf21 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:57.315758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 516/1033] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:57.321368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff9818-1935-4653-86ec-723ff7bbb72d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:57.321897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff9818-1935-4653-86ec-723ff7bbb72d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:57.322000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff9818-1935-4653-86ec-723ff7bbb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:57.365517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:57.400617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-dcff9818-1935-4653-86ec-723ff7bbb72d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:57.401841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dcff9818-1935-4653-86ec-723ff7bbb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:57.506716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 518/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:57.826438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d64f7d-16f7-45ef-9de9-d0beae802633 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:57.827761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d64f7d-16f7-45ef-9de9-d0beae802633 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:57.828374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d64f7d-16f7-45ef-9de9-d0beae802633 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:57.830625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 517/1035] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 05:54:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:54:57.839775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c23d4-a84c-4792-b070-3b1c1b3acc0e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:57.840063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c23d4-a84c-4792-b070-3b1c1b3acc0e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:57.840336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c23d4-a84c-4792-b070-3b1c1b3acc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:57.931665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-991c23d4-a84c-4792-b070-3b1c1b3acc0e None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:54:57.932812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-991c23d4-a84c-4792-b070-3b1c1b3acc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:57.989489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:58.063151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 519/1036] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:54:58.071479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d64f7d-16f7-45ef-9de9-d0beae802633 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:54:58.073128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-62d64f7d-16f7-45ef-9de9-d0beae802633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:58.229715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d64f7d-16f7-45ef-9de9-d0beae802633 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:54:58.306911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:54:58.348894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:54:58.349560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:54:58.349763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:54:58.350036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:54:58.351662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:54:58.455450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:54:58.457048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5cf68-1ff6-481c-ad9d-17b4889df2d4 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:54:58.476840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 518/1037] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:00.870855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675e31-3954-49f9-ab03-74505fdffcc0 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:00.871475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675e31-3954-49f9-ab03-74505fdffcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:00.871475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675e31-3954-49f9-ab03-74505fdffcc0 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:00.878207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 520/1038] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:00.879164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5b96-d8b3-440e-b13a-c0cf034367ea None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:00.879582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5b96-d8b3-440e-b13a-c0cf034367ea None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:00.879716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5b96-d8b3-440e-b13a-c0cf034367ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:00.955087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a0de5b96-d8b3-440e-b13a-c0cf034367ea None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:00.956314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a0de5b96-d8b3-440e-b13a-c0cf034367ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:00.997660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:01.060772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 519/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:55:01.356735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84675e31-3954-49f9-ab03-74505fdffcc0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:01.358584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-84675e31-3954-49f9-ab03-74505fdffcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:01.541035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84675e31-3954-49f9-ab03-74505fdffcc0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:01.552232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:01.667272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:01.667881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:01.668156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:01.668554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:01.670291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:01.762913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:01.765998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84815c5a-c9c8-4a54-a954-ec3f8861a1ae service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:01.784229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 521/1040] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:04.286348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2083f9-cab4-4424-aa39-fdb0d1aa4bc0 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:04.286916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2083f9-cab4-4424-aa39-fdb0d1aa4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:04.286916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2083f9-cab4-4424-aa39-fdb0d1aa4bc0 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:04.288231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 520/1041] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:04.293676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7efb-fdc4-4d9d-8327-f55849811767 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:04.294092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7efb-fdc4-4d9d-8327-f55849811767 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:04.294266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7efb-fdc4-4d9d-8327-f55849811767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:04.311236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:04.367605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d9dd7efb-fdc4-4d9d-8327-f55849811767 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:04.368814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d9dd7efb-fdc4-4d9d-8327-f55849811767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:04.474302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 522/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:04.772087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591536-6061-413f-9b31-4c57c2c9e7b2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:04.772387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591536-6061-413f-9b31-4c57c2c9e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:04.772636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591536-6061-413f-9b31-4c57c2c9e7b2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:04.774122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 521/1043] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 05:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:04.779323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f081de-612b-41b5-a5d8-41b12bbcc050 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:04.779906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f081de-612b-41b5-a5d8-41b12bbcc050 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:04.780277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f081de-612b-41b5-a5d8-41b12bbcc050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:04.859190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-66f081de-612b-41b5-a5d8-41b12bbcc050 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:04.860547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-66f081de-612b-41b5-a5d8-41b12bbcc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:04.898518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:04.989671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 523/1044] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 05:55:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:04.997707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591536-6061-413f-9b31-4c57c2c9e7b2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:04.999468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-13591536-6061-413f-9b31-4c57c2c9e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:05.160794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591536-6061-413f-9b31-4c57c2c9e7b2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:05.188675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:05.289517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:05.290229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:05.290461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:05.290664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:05.292286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:05.387334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:05.390554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd26810-b705-4a87-a723-8bc707150414 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:05.410049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 522/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:05.546810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0eba-31b8-4242-8eea-2aa9f5d8b09c None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:05.547372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0eba-31b8-4242-8eea-2aa9f5d8b09c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:05.547708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0eba-31b8-4242-8eea-2aa9f5d8b09c None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:05.553829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 524/1046] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:05.556114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c911f-1ff9-4459-a18f-d2241967bc09 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:05.556403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c911f-1ff9-4459-a18f-d2241967bc09 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:05.556672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c911f-1ff9-4459-a18f-d2241967bc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:05.594416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:05.638275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a06c911f-1ff9-4459-a18f-d2241967bc09 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:05.640464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a06c911f-1ff9-4459-a18f-d2241967bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:05.751378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 523/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:06.087631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0609615-9d3b-4fcc-8d2e-15bcb9e89489 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:06.087631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0609615-9d3b-4fcc-8d2e-15bcb9e89489 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:06.087631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0609615-9d3b-4fcc-8d2e-15bcb9e89489 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:06.088774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 525/1048] 10.222.0.16 () {54 vars in 963 bytes} [Thu Oct 20 05:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:06.093849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18323-0595-44a5-8a46-556673814278 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:06.094132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18323-0595-44a5-8a46-556673814278 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:06.094403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18323-0595-44a5-8a46-556673814278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:06.177892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e5d18323-0595-44a5-8a46-556673814278 None None] MFA Rules not processed for user `8203173f183e4494b580181cd3647e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:06.179233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e5d18323-0595-44a5-8a46-556673814278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:06.229728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:06.262735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 524/1049] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Oct 20 05:55:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:06.271216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0609615-9d3b-4fcc-8d2e-15bcb9e89489 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:06.272717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f0609615-9d3b-4fcc-8d2e-15bcb9e89489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:06.381600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0609615-9d3b-4fcc-8d2e-15bcb9e89489 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:06.437478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:06.484419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:06.485613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:06.486384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:06.486883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:06.489882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:06.682185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:06.683934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cef73f-1bba-4e65-808e-c5f18d6afbe3 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:06.706533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 526/1050] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:07.651026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb16ff2-f3af-4684-8e7c-b3dd42ecce8b None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:07.651581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb16ff2-f3af-4684-8e7c-b3dd42ecce8b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:07.651581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb16ff2-f3af-4684-8e7c-b3dd42ecce8b None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:07.652900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 525/1051] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:07.659312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb0d7-56ee-469c-80ba-4a20f9454592 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:07.659712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb0d7-56ee-469c-80ba-4a20f9454592 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:07.660054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb0d7-56ee-469c-80ba-4a20f9454592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:07.725667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-50dbb0d7-56ee-469c-80ba-4a20f9454592 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:07.726910 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-50dbb0d7-56ee-469c-80ba-4a20f9454592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:07.748618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:07.827662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 527/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:08.125449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb16ff2-f3af-4684-8e7c-b3dd42ecce8b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:08.127090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3bb16ff2-f3af-4684-8e7c-b3dd42ecce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:08.294363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb16ff2-f3af-4684-8e7c-b3dd42ecce8b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:08.351797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:08.415937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:08.416677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:08.416969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:08.417240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:08.418902 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:08.510463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:08.512062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c3b64-3a53-46d9-8b28-0eed0dfb93df service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:08.531708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 526/1053] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 05:55:10.771050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b41f8-e535-40fa-83a6-d870e0b04ebc None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:10.771915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b41f8-e535-40fa-83a6-d870e0b04ebc None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:10.772262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b41f8-e535-40fa-83a6-d870e0b04ebc None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:10.773890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 528/1054] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:10.779144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c54c1-1317-44ce-b77e-b942d45b81c7 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:10.779905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c54c1-1317-44ce-b77e-b942d45b81c7 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:10.779905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c54c1-1317-44ce-b77e-b942d45b81c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:10.849273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8d6c54c1-1317-44ce-b77e-b942d45b81c7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:10.850497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d6c54c1-1317-44ce-b77e-b942d45b81c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:10.857723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:10.953792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 527/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:11.241001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b41f8-e535-40fa-83a6-d870e0b04ebc None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:11.242547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-db0b41f8-e535-40fa-83a6-d870e0b04ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:11.393479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b41f8-e535-40fa-83a6-d870e0b04ebc None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:11.397520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:11.511331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:11.511841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:11.512113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:11.512377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:11.514250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:11.605897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:11.607891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228fa34-cc77-42e1-a3b7-beb87f1c258c service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:11.626632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 529/1056] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:13.831343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41085d14-d267-4747-9bbc-9269bfae01bb None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:13.831845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41085d14-d267-4747-9bbc-9269bfae01bb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:13.831939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41085d14-d267-4747-9bbc-9269bfae01bb None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:13.833348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 528/1057] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:13.838533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321ef0-a1f0-4403-9043-4f0bafaa4bc2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:13.838927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321ef0-a1f0-4403-9043-4f0bafaa4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:13.839078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321ef0-a1f0-4403-9043-4f0bafaa4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:13.877187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:13.923356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-28321ef0-a1f0-4403-9043-4f0bafaa4bc2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:13.924565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-28321ef0-a1f0-4403-9043-4f0bafaa4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:14.033794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 530/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:14.326924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41085d14-d267-4747-9bbc-9269bfae01bb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:14.328688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-41085d14-d267-4747-9bbc-9269bfae01bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:14.477424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:14.491257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41085d14-d267-4747-9bbc-9269bfae01bb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:14.618213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:14.618759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:14.619048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:14.619328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:14.620987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:14.726070 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:14.727664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c70e69-66f2-4510-885e-4ebe42576254 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:14.738264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:14.746815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 529/1059] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:17.033844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243a6c-22f4-44b9-8501-b912d10717b0 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:17.034369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243a6c-22f4-44b9-8501-b912d10717b0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:17.034770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243a6c-22f4-44b9-8501-b912d10717b0 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:17.037316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 531/1060] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:17.042830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793e56-770a-4cae-bedd-9e4da6e615a6 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:17.043402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793e56-770a-4cae-bedd-9e4da6e615a6 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:17.043402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793e56-770a-4cae-bedd-9e4da6e615a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:17.116539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-15793e56-770a-4cae-bedd-9e4da6e615a6 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:17.117640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-15793e56-770a-4cae-bedd-9e4da6e615a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:17.226518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 530/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:55:17.561194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243a6c-22f4-44b9-8501-b912d10717b0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:17.562768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7d243a6c-22f4-44b9-8501-b912d10717b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:17.657257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:17.736876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243a6c-22f4-44b9-8501-b912d10717b0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:17.855549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:17.856162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:17.856438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:17.856710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:17.859105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:17.910798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:17.951754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:17.953356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f4e17-84c9-4542-966c-f13581baae29 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:17.971430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 532/1062] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:20.199348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b88d-af89-4209-83f6-3713c664285b None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:20.199911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b88d-af89-4209-83f6-3713c664285b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:20.199911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b88d-af89-4209-83f6-3713c664285b None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:20.202349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 531/1063] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:20.207399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356f23-cb68-4bd0-ae12-6e240e732c2d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:20.207828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356f23-cb68-4bd0-ae12-6e240e732c2d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:20.207927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356f23-cb68-4bd0-ae12-6e240e732c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:20.277950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ae356f23-cb68-4bd0-ae12-6e240e732c2d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:20.279167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ae356f23-cb68-4bd0-ae12-6e240e732c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:20.377209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 533/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:20.679358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041b88d-af89-4209-83f6-3713c664285b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:20.680885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0041b88d-af89-4209-83f6-3713c664285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:20.760300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:20.830560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041b88d-af89-4209-83f6-3713c664285b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:20.941022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:20.941571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:20.941870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:20.942140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:20.943760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:20.983408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:21.035531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:21.037125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81adbe7-3e6c-4f42-a046-e9593f340e84 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:21.055383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 532/1065] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:22.002949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dbe3b-9011-42e0-af87-ecb3ea6680e3 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:22.003447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dbe3b-9011-42e0-af87-ecb3ea6680e3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:22.003570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dbe3b-9011-42e0-af87-ecb3ea6680e3 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:22.004817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 534/1066] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:22.010175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40b11-95c7-4399-b965-12b09a5a030a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:22.010598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40b11-95c7-4399-b965-12b09a5a030a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:22.010706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40b11-95c7-4399-b965-12b09a5a030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:22.079765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-04e40b11-95c7-4399-b965-12b09a5a030a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:22.080909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-04e40b11-95c7-4399-b965-12b09a5a030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:22.177003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 533/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:22.488128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4f4b4-f092-49ef-a9b8-cec2564ed144 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:22.488409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4f4b4-f092-49ef-a9b8-cec2564ed144 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:22.488683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4f4b4-f092-49ef-a9b8-cec2564ed144 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:22.490069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 535/1068] 10.222.0.16 () {54 vars in 962 bytes} [Thu Oct 20 05:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:22.495206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c439a-165b-453e-8f61-eaf8042c5a80 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:22.495493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c439a-165b-453e-8f61-eaf8042c5a80 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:22.495767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c439a-165b-453e-8f61-eaf8042c5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:22.511993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:22.574028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-240c439a-165b-453e-8f61-eaf8042c5a80 None None] MFA Rules not processed for user `a667b7903d5c484e891e69382f6d20e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:22.575229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-240c439a-165b-453e-8f61-eaf8042c5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:22.651942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 534/1069] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Oct 20 05:55:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:22.661024 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4f4b4-f092-49ef-a9b8-cec2564ed144 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:22.662800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b8c4f4b4-f092-49ef-a9b8-cec2564ed144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:22.694357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:22.768719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4f4b4-f092-49ef-a9b8-cec2564ed144 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:22.846400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:22.847028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:22.847288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:22.847554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:22.849158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:22.933347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:22.968055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:22.969500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7a11f-a545-44e8-b51c-a1d285f53977 service glance] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:22.988131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 536/1070] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:23.240189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d04221-2c5a-4800-ad7c-de7142241811 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:23.240797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d04221-2c5a-4800-ad7c-de7142241811 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:23.240797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d04221-2c5a-4800-ad7c-de7142241811 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:23.242114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 535/1071] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:23.248707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af14dfb-44c3-4b59-ab6e-17a98d884ce9 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:23.249289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af14dfb-44c3-4b59-ab6e-17a98d884ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:23.249393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af14dfb-44c3-4b59-ab6e-17a98d884ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:23.318371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5af14dfb-44c3-4b59-ab6e-17a98d884ce9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:23.319592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5af14dfb-44c3-4b59-ab6e-17a98d884ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:23.436147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 537/1072] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:23.729050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d04221-2c5a-4800-ad7c-de7142241811 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:23.730607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-85d04221-2c5a-4800-ad7c-de7142241811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:23.742840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2d3e1-b435-4357-8824-8392aa23fcf3 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:23.743160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2d3e1-b435-4357-8824-8392aa23fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:23.743453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2d3e1-b435-4357-8824-8392aa23fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:23.789393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:23.813386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-15f2d3e1-b435-4357-8824-8392aa23fcf3 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:23.814721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-15f2d3e1-b435-4357-8824-8392aa23fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:23.836731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:23.883443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d04221-2c5a-4800-ad7c-de7142241811 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:23.902176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 538/1073] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 05:55:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:23.948596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f44f1-c80b-48bb-8004-207d129e26a4 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:23.948885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f44f1-c80b-48bb-8004-207d129e26a4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:23.949158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f44f1-c80b-48bb-8004-207d129e26a4 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:23.951088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 539/1074] 10.222.0.16 () {54 vars in 943 bytes} [Thu Oct 20 05:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 05:55:23.959897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cab4a4-e00a-42ee-a093-4c24317d75c4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:23.960365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cab4a4-e00a-42ee-a093-4c24317d75c4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:23.960820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cab4a4-e00a-42ee-a093-4c24317d75c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:24.004000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:24.004603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:24.004874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:24.005144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:24.006756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:24.042908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a1cab4a4-e00a-42ee-a093-4c24317d75c4 None None] MFA Rules not processed for user `bc7643a92cc44ea8b718a4f8532105ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:24.044100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a1cab4a4-e00a-42ee-a093-4c24317d75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:24.078093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:24.098250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:24.099838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:24.106480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:24.118523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 536/1075] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:24.153564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 540/1076] 10.222.0.16 () {58 vars in 1040 bytes} [Thu Oct 20 05:55:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:55:24.163550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:24.164755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:24.261394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268fb06-2d2c-428d-99c0-afa7227eb52d service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:24.371453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:24.373414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:24.374057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:24.374342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:24.374864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:24.376917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:24.460640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:24.462272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c886ce-ae3d-433f-8179-4d41c4f44c18 service swift] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:24.470897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 537/1077] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 05:55:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 05:55:26.380929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec52c9-f943-48f5-882c-1fa600b6e70c None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:26.381472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec52c9-f943-48f5-882c-1fa600b6e70c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:26.381472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec52c9-f943-48f5-882c-1fa600b6e70c None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:26.383128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 541/1078] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:26.389344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cee0-99f9-43ff-8a45-70dcebd326d7 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:26.389814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cee0-99f9-43ff-8a45-70dcebd326d7 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:26.389957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cee0-99f9-43ff-8a45-70dcebd326d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:26.468059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-74a5cee0-99f9-43ff-8a45-70dcebd326d7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:26.469282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-74a5cee0-99f9-43ff-8a45-70dcebd326d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:26.571460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:26.579824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 538/1079] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:26.875166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec52c9-f943-48f5-882c-1fa600b6e70c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:26.876692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1dec52c9-f943-48f5-882c-1fa600b6e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:27.048137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec52c9-f943-48f5-882c-1fa600b6e70c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:27.096358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:27.180070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:27.181034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:27.181544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:27.182049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:27.183895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:27.285114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:27.286752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0438ca-3b08-4d85-a1c9-f946be1ceb6b service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:27.307637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 542/1080] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:29.533037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec0643-b105-4f87-aa96-523c2497dcac None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:29.533599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec0643-b105-4f87-aa96-523c2497dcac None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:29.533599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec0643-b105-4f87-aa96-523c2497dcac None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:29.535115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 539/1081] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:29.540634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60b00-ae4a-4240-be5f-cb465ad309be None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:29.541078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60b00-ae4a-4240-be5f-cb465ad309be None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:29.541158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60b00-ae4a-4240-be5f-cb465ad309be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:29.623824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:29.635086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-07b60b00-ae4a-4240-be5f-cb465ad309be None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:29.636907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-07b60b00-ae4a-4240-be5f-cb465ad309be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:29.769879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 543/1082] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:30.064802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec0643-b105-4f87-aa96-523c2497dcac None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:30.066454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f8ec0643-b105-4f87-aa96-523c2497dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:30.232334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec0643-b105-4f87-aa96-523c2497dcac None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:30.306229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:30.355449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:30.356047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:30.356347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:30.356778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:30.358503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:30.458290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:30.459908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfe0ca-d6b4-402d-b318-e3978e30aff2 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:30.481933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 540/1083] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:32.698969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fd745-21d2-46a1-b255-c8e5db9bedb4 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:32.699536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fd745-21d2-46a1-b255-c8e5db9bedb4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:32.699536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fd745-21d2-46a1-b255-c8e5db9bedb4 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:32.701580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 544/1084] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:32.706708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce90c-9d10-4cb0-a086-e5b6dc34f7bf None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:32.707148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce90c-9d10-4cb0-a086-e5b6dc34f7bf None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:32.707244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce90c-9d10-4cb0-a086-e5b6dc34f7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:32.781391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-593ce90c-9d10-4cb0-a086-e5b6dc34f7bf None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:32.782680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-593ce90c-9d10-4cb0-a086-e5b6dc34f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:32.820337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:32.900927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 541/1085] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:33.208130 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fd745-21d2-46a1-b255-c8e5db9bedb4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:33.211982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-385fd745-21d2-46a1-b255-c8e5db9bedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:33.344310 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:33.376826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fd745-21d2-46a1-b255-c8e5db9bedb4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:33.501207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:33.501850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:33.502127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:33.502415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:33.504003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:33.601869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:33.605768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:33.608144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007b593-2a55-4639-a795-83fdf015c95c service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:33.627563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 545/1086] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:42.899267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=30 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:43.624576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=7 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:47.107527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bab0b-efa9-44a8-a64b-3b8a874355cc None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:47.108093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bab0b-efa9-44a8-a64b-3b8a874355cc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:47.108093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bab0b-efa9-44a8-a64b-3b8a874355cc None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:47.109395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 542/1087] 10.222.0.16 () {54 vars in 918 bytes} [Thu Oct 20 05:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:47.114550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843f97-4c01-4c13-a925-7ae40c8032bd None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:47.114947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843f97-4c01-4c13-a925-7ae40c8032bd None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:47.115256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843f97-4c01-4c13-a925-7ae40c8032bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:47.189851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d4843f97-4c01-4c13-a925-7ae40c8032bd None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:47.191048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d4843f97-4c01-4c13-a925-7ae40c8032bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:47.296322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 546/1088] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 20 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:47.311277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4cb3-db03-4c85-aff6-b638cfd5d05c None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:47.311558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4cb3-db03-4c85-aff6-b638cfd5d05c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:47.311831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4cb3-db03-4c85-aff6-b638cfd5d05c None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:47.313141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 543/1089] 10.222.0.16 () {54 vars in 918 bytes} [Thu Oct 20 05:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:47.317877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e78fd-b487-4177-aebe-85856186d767 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:47.318159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e78fd-b487-4177-aebe-85856186d767 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:47.318431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e78fd-b487-4177-aebe-85856186d767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:47.391350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:47.394061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b82e78fd-b487-4177-aebe-85856186d767 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:47.395801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b82e78fd-b487-4177-aebe-85856186d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:47.509941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 547/1090] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 20 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:55:50.155589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145eda5-68df-4d18-81f3-b935a12a0933 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:50.156104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145eda5-68df-4d18-81f3-b935a12a0933 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:50.156104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145eda5-68df-4d18-81f3-b935a12a0933 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:50.157374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 544/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:50.162839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adec194-42b3-4f60-80c7-88d74c660ef1 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:50.163302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adec194-42b3-4f60-80c7-88d74c660ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:50.163408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adec194-42b3-4f60-80c7-88d74c660ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:50.232461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7adec194-42b3-4f60-80c7-88d74c660ef1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:50.233668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7adec194-42b3-4f60-80c7-88d74c660ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:50.288171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:50.330224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 548/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:50.619246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145eda5-68df-4d18-81f3-b935a12a0933 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:50.620776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9145eda5-68df-4d18-81f3-b935a12a0933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:50.768450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145eda5-68df-4d18-81f3-b935a12a0933 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:50.844961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:50.885325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:50.885878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:50.886150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:50.886413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:50.888268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:50.975726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:50.977615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de3a8c-daeb-436e-aeff-ed0696e770b4 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:50.996007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 545/1093] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:52.124390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142944-c9e6-4c7e-a58d-b70bf3fb4307 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:52.124949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142944-c9e6-4c7e-a58d-b70bf3fb4307 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:52.124949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142944-c9e6-4c7e-a58d-b70bf3fb4307 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:52.126197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 549/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:52.132317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61c01-95a5-44d9-843d-79b00848d59b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:52.132736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61c01-95a5-44d9-843d-79b00848d59b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:52.132847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61c01-95a5-44d9-843d-79b00848d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:52.208643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9ab61c01-95a5-44d9-843d-79b00848d59b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:52.209865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9ab61c01-95a5-44d9-843d-79b00848d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:52.236010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:52.305680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 546/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:52.455700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142944-c9e6-4c7e-a58d-b70bf3fb4307 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:52.457150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c4142944-c9e6-4c7e-a58d-b70bf3fb4307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:52.601253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142944-c9e6-4c7e-a58d-b70bf3fb4307 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:52.641329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:52.712684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:52.713204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:52.713478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:52.713796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:52.716041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:52.803407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:52.804997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bbc06-4700-452c-9358-df43cab80428 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:52.822687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 550/1096] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:53.947909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8460d-68d8-4fce-8a9c-2b2dc54d79a4 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:53.948443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8460d-68d8-4fce-8a9c-2b2dc54d79a4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:53.948443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8460d-68d8-4fce-8a9c-2b2dc54d79a4 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:53.950720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 547/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:53.956909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ec89-0833-42f5-894b-be0f7002e83d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:53.957335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ec89-0833-42f5-894b-be0f7002e83d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:53.957484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ec89-0833-42f5-894b-be0f7002e83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:54.013120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:54.035446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7613ec89-0833-42f5-894b-be0f7002e83d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:54.036661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7613ec89-0833-42f5-894b-be0f7002e83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:54.130162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 551/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:54.282018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8460d-68d8-4fce-8a9c-2b2dc54d79a4 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:54.283554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-52f8460d-68d8-4fce-8a9c-2b2dc54d79a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:54.426822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8460d-68d8-4fce-8a9c-2b2dc54d79a4 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:54.438651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:54.538356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:54.538980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:54.539258 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:54.539527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:54.541104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:54.629806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:54.631385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23afa-7214-416c-bf23-2e1a19763cac service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:54.649320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 548/1099] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:55.749591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9da75-3633-48eb-9fae-eb7bf54a7a7a None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:55.750294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9da75-3633-48eb-9fae-eb7bf54a7a7a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:55.750294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9da75-3633-48eb-9fae-eb7bf54a7a7a None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:55.751493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 552/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:55.757558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b0417-dd09-48cb-a8b4-cb91dc9c580f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:55.757999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b0417-dd09-48cb-a8b4-cb91dc9c580f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:55.758136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b0417-dd09-48cb-a8b4-cb91dc9c580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:55.779081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:55.837075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ca6b0417-dd09-48cb-a8b4-cb91dc9c580f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:55.838329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ca6b0417-dd09-48cb-a8b4-cb91dc9c580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:55.937450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 549/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:56.089578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9da75-3633-48eb-9fae-eb7bf54a7a7a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:56.091190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-11b9da75-3633-48eb-9fae-eb7bf54a7a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:56.199982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:56.234799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9da75-3633-48eb-9fae-eb7bf54a7a7a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:56.345291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:56.345843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:56.346125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:56.346399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:56.347987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:56.424975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:56.438806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:56.440428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32c6a6-d605-4f78-9ce8-10236400891f service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:56.458494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 553/1102] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:57.574000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae06c-7663-4bcf-bf0f-7b52052ccee1 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:57.574688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae06c-7663-4bcf-bf0f-7b52052ccee1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:57.574688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae06c-7663-4bcf-bf0f-7b52052ccee1 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:57.576000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 550/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:57.582203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33049-a44a-4d67-b047-606c8ff89b60 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:57.582657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33049-a44a-4d67-b047-606c8ff89b60 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:57.582751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33049-a44a-4d67-b047-606c8ff89b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:57.659285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9fc33049-a44a-4d67-b047-606c8ff89b60 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:57.660558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9fc33049-a44a-4d67-b047-606c8ff89b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:57.758626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 554/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:57.912938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae06c-7663-4bcf-bf0f-7b52052ccee1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:57.914508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7b7ae06c-7663-4bcf-bf0f-7b52052ccee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:58.000209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:58.062161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae06c-7663-4bcf-bf0f-7b52052ccee1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:58.174034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:58.174556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:58.174835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:58.175107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:58.176698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:58.224144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:58.266026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:55:58.267613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c98a-7366-44d9-8689-b373685a5a61 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:55:58.285913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 551/1105] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:55:59.340730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f408-be87-4e2c-8c1c-1f056196a023 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:59.341188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f408-be87-4e2c-8c1c-1f056196a023 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:59.341307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f408-be87-4e2c-8c1c-1f056196a023 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:59.342685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 555/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:55:59.348917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9cfb-de35-473b-a181-db3270083f4a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:59.349358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9cfb-de35-473b-a181-db3270083f4a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:59.349456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9cfb-de35-473b-a181-db3270083f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:59.425907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2eab9cfb-de35-473b-a181-db3270083f4a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:55:59.427092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2eab9cfb-de35-473b-a181-db3270083f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:59.521836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 552/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:55:59.672470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f408-be87-4e2c-8c1c-1f056196a023 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:55:59.674023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4068f408-be87-4e2c-8c1c-1f056196a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:59.723142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:55:59.819113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f408-be87-4e2c-8c1c-1f056196a023 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:55:59.930340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:55:59.930858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:55:59.931135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:55:59.931401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:55:59.932977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:55:59.940613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:00.024316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:00.026280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff5b97-2238-467f-b1e0-c0b447a4d724 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:00.044403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 556/1108] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:01.101406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58039d1-33d0-4183-999f-745165458c7e None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:01.101998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58039d1-33d0-4183-999f-745165458c7e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:01.101998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58039d1-33d0-4183-999f-745165458c7e None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:01.103305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 553/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:01.110313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3d3d-25f5-46eb-8a04-07d3760a3d62 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:01.110781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3d3d-25f5-46eb-8a04-07d3760a3d62 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:01.110888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3d3d-25f5-46eb-8a04-07d3760a3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:01.185441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8b0e3d3d-25f5-46eb-8a04-07d3760a3d62 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:01.186692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8b0e3d3d-25f5-46eb-8a04-07d3760a3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:01.252918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:01.282209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 557/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:01.435644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58039d1-33d0-4183-999f-745165458c7e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:01.437143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e58039d1-33d0-4183-999f-745165458c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:01.454155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:01.585791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58039d1-33d0-4183-999f-745165458c7e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:01.673016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:01.698643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:01.699585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:01.699866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:01.700138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:01.701727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:01.789962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:01.791547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebee24-0e56-4f55-8e82-b491b94c650d service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:01.809560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 554/1111] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:02.848581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250a71-67a5-45ba-9a1f-aec9cca4aeec None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:02.849144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250a71-67a5-45ba-9a1f-aec9cca4aeec None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:02.849144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250a71-67a5-45ba-9a1f-aec9cca4aeec None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:02.850482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 558/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:02.857802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe539f-adb4-4390-b9ef-431198601cd2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:02.858214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe539f-adb4-4390-b9ef-431198601cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:02.858346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe539f-adb4-4390-b9ef-431198601cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:02.935608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-75fe539f-adb4-4390-b9ef-431198601cd2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:02.936799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-75fe539f-adb4-4390-b9ef-431198601cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:02.982553 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:03.032499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 555/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:56:03.182010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2250a71-67a5-45ba-9a1f-aec9cca4aeec None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:03.184061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b2250a71-67a5-45ba-9a1f-aec9cca4aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:03.326463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2250a71-67a5-45ba-9a1f-aec9cca4aeec None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:03.382955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:03.441961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:03.442495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:03.442780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:03.443049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:03.444645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:03.533697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:03.535326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed652276-8a66-4d4f-8f67-17e3a9231383 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:03.553225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 559/1114] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:04.627359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1337f-6de9-4477-808d-cacac544e6e8 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:04.627923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1337f-6de9-4477-808d-cacac544e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:04.627923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1337f-6de9-4477-808d-cacac544e6e8 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:04.629233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 556/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 05:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:04.635282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00aa6-2c11-44c8-a862-b69dd0a0c060 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:04.635670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00aa6-2c11-44c8-a862-b69dd0a0c060 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:04.635827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00aa6-2c11-44c8-a862-b69dd0a0c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:04.712924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e6e00aa6-2c11-44c8-a862-b69dd0a0c060 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:04.714159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e6e00aa6-2c11-44c8-a862-b69dd0a0c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:04.716750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:04.810056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 560/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 05:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:04.959418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1337f-6de9-4477-808d-cacac544e6e8 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:04.960929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-bae1337f-6de9-4477-808d-cacac544e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:05.104437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1337f-6de9-4477-808d-cacac544e6e8 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:05.130954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:05.216670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:05.217262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:05.217534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:05.217834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:05.219743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:05.306929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:05.309056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706ab13-43c4-4adb-8db0-e9c49ca9a958 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:05.326548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 557/1117] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:07.440338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85924c9c-4088-4bb6-9527-09834acfc541 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:07.440937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85924c9c-4088-4bb6-9527-09834acfc541 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:07.440937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85924c9c-4088-4bb6-9527-09834acfc541 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:07.442266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 561/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:07.447438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3f223-0b81-49ed-a492-b4a4d7ca4aec None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:07.447893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3f223-0b81-49ed-a492-b4a4d7ca4aec None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:07.448009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3f223-0b81-49ed-a492-b4a4d7ca4aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:07.490177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:07.516524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6df3f223-0b81-49ed-a492-b4a4d7ca4aec None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:07.517714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6df3f223-0b81-49ed-a492-b4a4d7ca4aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:07.612273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 558/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:07.896198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85924c9c-4088-4bb6-9527-09834acfc541 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:07.897787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-85924c9c-4088-4bb6-9527-09834acfc541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:08.001723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85924c9c-4088-4bb6-9527-09834acfc541 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:08.033905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:08.076105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:08.076711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:08.076990 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:08.077259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:08.078899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:08.186377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:08.187800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11081-7e54-4271-a004-2d88b814142d service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:08.205259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 562/1120] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:10.507203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3201ff-3c56-4021-b60c-f96faa22d662 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:10.507748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3201ff-3c56-4021-b60c-f96faa22d662 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:10.508005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3201ff-3c56-4021-b60c-f96faa22d662 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:10.509385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 559/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:10.515478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c935a-f76d-42bb-9238-0864554984b4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:10.515920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c935a-f76d-42bb-9238-0864554984b4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:10.516067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c935a-f76d-42bb-9238-0864554984b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:10.580552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-677c935a-f76d-42bb-9238-0864554984b4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:10.581756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-677c935a-f76d-42bb-9238-0864554984b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:10.595218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:10.677939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 563/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:10.964880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3201ff-3c56-4021-b60c-f96faa22d662 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:10.966431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dd3201ff-3c56-4021-b60c-f96faa22d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:11.067224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3201ff-3c56-4021-b60c-f96faa22d662 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:11.080511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:11.141863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:11.142461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:11.142732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:11.142997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:11.144560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:11.249490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:11.250865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1a5a-2000-47b4-bfed-ed18936d386c service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:11.268798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 560/1123] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:13.719713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eab6e-0f82-4ce3-afbe-3a4298f8efd5 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:13.720331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eab6e-0f82-4ce3-afbe-3a4298f8efd5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:13.720331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eab6e-0f82-4ce3-afbe-3a4298f8efd5 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:13.721607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 564/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:13.726988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4419f-1fcb-4512-97f2-67012f3921d3 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:13.727383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4419f-1fcb-4512-97f2-67012f3921d3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:13.727542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4419f-1fcb-4512-97f2-67012f3921d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:13.776469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:13.794571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0fc4419f-1fcb-4512-97f2-67012f3921d3 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:13.795784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0fc4419f-1fcb-4512-97f2-67012f3921d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:13.895947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 561/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:14.183725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eab6e-0f82-4ce3-afbe-3a4298f8efd5 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:14.185624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8d8eab6e-0f82-4ce3-afbe-3a4298f8efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:14.287021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eab6e-0f82-4ce3-afbe-3a4298f8efd5 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:14.326465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:14.361829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:14.362773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:14.363064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:14.363336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:14.364924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:14.475614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:14.477037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eb620-20b1-4223-9016-8bb6b4df3ea7 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:14.494801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 565/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:16.845938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f56cd-69a5-47c3-bfd2-91d4efc831a6 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:16.846511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f56cd-69a5-47c3-bfd2-91d4efc831a6 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:16.846511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f56cd-69a5-47c3-bfd2-91d4efc831a6 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:16.847817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 562/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:16.853469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21639-bec8-4cee-a469-95ee6714b83b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:16.853922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21639-bec8-4cee-a469-95ee6714b83b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:16.854040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21639-bec8-4cee-a469-95ee6714b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:16.921461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e8b21639-bec8-4cee-a469-95ee6714b83b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:16.922700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e8b21639-bec8-4cee-a469-95ee6714b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:16.945245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:17.023648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 566/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:17.310567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f56cd-69a5-47c3-bfd2-91d4efc831a6 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:17.312112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-644f56cd-69a5-47c3-bfd2-91d4efc831a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:17.415706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f56cd-69a5-47c3-bfd2-91d4efc831a6 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:17.435978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:17.488669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:17.489268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:17.489548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:17.489854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:17.491439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:17.598552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:17.599915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4494636-bb67-434e-af49-36005ee123e8 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:17.617877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 563/1129] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:19.834164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426bf1-dbcb-4f68-9d81-a9697a158f98 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:19.834752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426bf1-dbcb-4f68-9d81-a9697a158f98 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:19.834752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426bf1-dbcb-4f68-9d81-a9697a158f98 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:19.836050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 567/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:19.842237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8605-18bf-415a-83b3-f505a7bb860f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:19.842661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8605-18bf-415a-83b3-f505a7bb860f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:19.842878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8605-18bf-415a-83b3-f505a7bb860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:19.905814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:19.908836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-22ec8605-18bf-415a-83b3-f505a7bb860f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:19.910581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-22ec8605-18bf-415a-83b3-f505a7bb860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:20.007613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 564/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:20.287929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426bf1-dbcb-4f68-9d81-a9697a158f98 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:20.289505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d1426bf1-dbcb-4f68-9d81-a9697a158f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:20.391431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426bf1-dbcb-4f68-9d81-a9697a158f98 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:20.441121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:20.467013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:20.467620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:20.467904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:20.468181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:20.469805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:20.578942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:20.580429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6515c-4e5a-4e93-b32a-11fad777b434 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:20.598833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 568/1132] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:22.787155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a74c5-86fd-4d86-9590-d73a96e0f200 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:22.787740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a74c5-86fd-4d86-9590-d73a96e0f200 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:22.787740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a74c5-86fd-4d86-9590-d73a96e0f200 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:22.789005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 565/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:22.794438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a626-3aaa-4041-9ae3-b237786d3279 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:22.794850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a626-3aaa-4041-9ae3-b237786d3279 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:22.794979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a626-3aaa-4041-9ae3-b237786d3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:22.859014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f5e2a626-3aaa-4041-9ae3-b237786d3279 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:22.860345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f5e2a626-3aaa-4041-9ae3-b237786d3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:22.890565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:22.957228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 569/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:23.240554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a74c5-86fd-4d86-9590-d73a96e0f200 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:23.242139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-916a74c5-86fd-4d86-9590-d73a96e0f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:23.343935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a74c5-86fd-4d86-9590-d73a96e0f200 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:23.371939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:23.416322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:23.417604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:23.417915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:23.418186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:23.419759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:23.525505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:23.527519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38694d59-7175-45c9-9541-d050152aee78 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:23.545399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 566/1135] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:25.739748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5276a-b508-42ce-a871-5a754206ff65 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:25.740383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5276a-b508-42ce-a871-5a754206ff65 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:25.740383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5276a-b508-42ce-a871-5a754206ff65 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:25.741643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:25.747495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552c61-b85c-48b9-8c0d-a962a5b28b69 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:25.747933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552c61-b85c-48b9-8c0d-a962a5b28b69 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:25.748044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552c61-b85c-48b9-8c0d-a962a5b28b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:25.814031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8e552c61-b85c-48b9-8c0d-a962a5b28b69 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:25.815213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8e552c61-b85c-48b9-8c0d-a962a5b28b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:25.823988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:25.912552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:26.197454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5276a-b508-42ce-a871-5a754206ff65 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:26.200008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7cf5276a-b508-42ce-a871-5a754206ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:26.303404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5276a-b508-42ce-a871-5a754206ff65 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:26.357370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:26.374915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:26.375505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:26.375779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:26.376046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:26.377621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:26.485651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:26.487322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab61a5-8f8a-466f-94d6-51b977102b83 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:26.505426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 571/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:28.704042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428af59-5b9e-42fb-b7df-a535155a8c39 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:28.704625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428af59-5b9e-42fb-b7df-a535155a8c39 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:28.704625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428af59-5b9e-42fb-b7df-a535155a8c39 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:28.706002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:28.711363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad51021-d9ec-4bfc-b9cb-1d0d371855e6 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:28.711789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad51021-d9ec-4bfc-b9cb-1d0d371855e6 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:28.711897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad51021-d9ec-4bfc-b9cb-1d0d371855e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:28.778034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-fad51021-d9ec-4bfc-b9cb-1d0d371855e6 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:28.779162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fad51021-d9ec-4bfc-b9cb-1d0d371855e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:28.816767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:28.873537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:29.161267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428af59-5b9e-42fb-b7df-a535155a8c39 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:29.162815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a428af59-5b9e-42fb-b7df-a535155a8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:29.265264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428af59-5b9e-42fb-b7df-a535155a8c39 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:29.302798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:29.338325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:29.339088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:29.339398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:29.339671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:29.341263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:29.449152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:29.450528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45738621-0db5-43a8-9b3d-04252276c338 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:29.468539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 569/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:31.623311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ee48-e8ad-42a2-bd9d-f0337ff93ea7 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:31.623903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ee48-e8ad-42a2-bd9d-f0337ff93ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:31.623903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ee48-e8ad-42a2-bd9d-f0337ff93ea7 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:31.625232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:31.630822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1277b-e669-49df-ba49-58aff723ef02 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:31.631246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1277b-e669-49df-ba49-58aff723ef02 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:31.631383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1277b-e669-49df-ba49-58aff723ef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:31.698607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-80b1277b-e669-49df-ba49-58aff723ef02 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:31.699795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-80b1277b-e669-49df-ba49-58aff723ef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:31.718678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:31.796209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:32.082180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ee48-e8ad-42a2-bd9d-f0337ff93ea7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:32.083722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-57b6ee48-e8ad-42a2-bd9d-f0337ff93ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:32.185244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ee48-e8ad-42a2-bd9d-f0337ff93ea7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:32.249076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:32.256112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:32.256750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:32.257026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:32.257319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:32.258939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:32.369975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:32.371691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdf55a-b620-4728-a524-307983e48020 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:32.390789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 574/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:34.581127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beaf86-5d5f-4431-be1e-04d457ad9ec1 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:34.581710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beaf86-5d5f-4431-be1e-04d457ad9ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:34.581710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beaf86-5d5f-4431-be1e-04d457ad9ec1 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:34.583019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 05:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:34.588252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec5e2-a729-4f33-8c40-9a2de4f78290 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:34.588804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec5e2-a729-4f33-8c40-9a2de4f78290 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:34.588804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec5e2-a729-4f33-8c40-9a2de4f78290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:34.654150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-adbec5e2-a729-4f33-8c40-9a2de4f78290 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:34.655353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-adbec5e2-a729-4f33-8c40-9a2de4f78290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:34.704197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:34.753724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:35.035670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beaf86-5d5f-4431-be1e-04d457ad9ec1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:35.037232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-74beaf86-5d5f-4431-be1e-04d457ad9ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:35.145986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beaf86-5d5f-4431-be1e-04d457ad9ec1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:35.194267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:35.221618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:35.222245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:35.222518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:35.222781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:35.224357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:35.333507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:35.334957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6380eb-6cdc-4f6f-8400-4d5b91adbe8b service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:35.353538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 572/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:44.752181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=22 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:45.351284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=66 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:55.382211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c673d33-4532-4c91-8805-4063126b4c3b None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:55.382785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c673d33-4532-4c91-8805-4063126b4c3b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:55.382785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c673d33-4532-4c91-8805-4063126b4c3b None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:55.384081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 576/1148] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:55.389863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502da7-50c1-474c-8b00-a498f17b8ff2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:55.390351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502da7-50c1-474c-8b00-a498f17b8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:55.390449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502da7-50c1-474c-8b00-a498f17b8ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:55.455756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9a502da7-50c1-474c-8b00-a498f17b8ff2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:55.456945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9a502da7-50c1-474c-8b00-a498f17b8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:55.551721 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 573/1149] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:55.850730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80436-6536-4d24-83ab-75cbcabb3a3c None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:55.851013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80436-6536-4d24-83ab-75cbcabb3a3c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:55.851287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80436-6536-4d24-83ab-75cbcabb3a3c None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:55.852625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 577/1150] 10.222.0.16 () {54 vars in 962 bytes} [Thu Oct 20 05:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:55.857521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc6887-06c3-4080-9b34-d5679d610c25 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:55.857834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc6887-06c3-4080-9b34-d5679d610c25 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:55.858131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc6887-06c3-4080-9b34-d5679d610c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:55.934831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-96bc6887-06c3-4080-9b34-d5679d610c25 None None] MFA Rules not processed for user `a667b7903d5c484e891e69382f6d20e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:55.936007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-96bc6887-06c3-4080-9b34-d5679d610c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:55.956219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:56.013699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 574/1151] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Oct 20 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:56:56.021594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f80436-6536-4d24-83ab-75cbcabb3a3c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:56.023140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-59f80436-6536-4d24-83ab-75cbcabb3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:56.124843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f80436-6536-4d24-83ab-75cbcabb3a3c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:56.197481 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:56.198175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:56.198453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:56.198723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:56.200301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:56.253110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:56.308286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:56.309715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2ac33-9bbe-478b-b30f-f1296489c24e service glance] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:56.327520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 578/1152] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:56:58.581373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af2d-4619-4cdf-99fd-e55de4e33c80 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:58.581967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af2d-4619-4cdf-99fd-e55de4e33c80 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:58.581967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af2d-4619-4cdf-99fd-e55de4e33c80 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:58.583264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 575/1153] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:56:58.589029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabd770-bf4e-490d-b13a-24edfa8f1d26 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:58.589443 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabd770-bf4e-490d-b13a-24edfa8f1d26 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:58.589573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabd770-bf4e-490d-b13a-24edfa8f1d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:58.654531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-acabd770-bf4e-490d-b13a-24edfa8f1d26 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:56:58.655736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-acabd770-bf4e-490d-b13a-24edfa8f1d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:58.750472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 579/1154] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:56:59.031192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74af2d-4619-4cdf-99fd-e55de4e33c80 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:56:59.032630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7d74af2d-4619-4cdf-99fd-e55de4e33c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:56:59.161519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74af2d-4619-4cdf-99fd-e55de4e33c80 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:56:59.210836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:56:59.255648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:56:59.256239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:56:59.256512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:56:59.256804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:56:59.257428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:56:59.258466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:56:59.258466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:56:59.258466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:56:59.259601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883832a-b8b7-49e7-986b-23f6d7d8665e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:56:59.278397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 576/1155] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 05:56:59 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:57:01.429521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec92e8-e7e3-4a54-9e9e-4575c7727868 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:01.430125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec92e8-e7e3-4a54-9e9e-4575c7727868 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:01.430125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec92e8-e7e3-4a54-9e9e-4575c7727868 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:01.431410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 580/1156] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:57:01.437457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a7c5a-1222-4062-8dd9-df20621b3b34 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:01.437881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a7c5a-1222-4062-8dd9-df20621b3b34 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:01.438032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a7c5a-1222-4062-8dd9-df20621b3b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:01.505044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f99a7c5a-1222-4062-8dd9-df20621b3b34 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:57:01.506280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f99a7c5a-1222-4062-8dd9-df20621b3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:01.602483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 577/1157] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:57:01.897698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec92e8-e7e3-4a54-9e9e-4575c7727868 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:57:01.899129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1cec92e8-e7e3-4a54-9e9e-4575c7727868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:01.908978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:02.044456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec92e8-e7e3-4a54-9e9e-4575c7727868 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:57:02.123922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:02.156473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:57:02.157074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:02.157348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:02.157612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:02.159224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:02.248159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:57:02.249774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b985f8-9b77-4510-ba5b-c584f26f23aa service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:57:02.268084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 581/1158] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:57:04.591949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e3c40-85f6-40b8-aeb1-49ab7765d730 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:04.592535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e3c40-85f6-40b8-aeb1-49ab7765d730 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:04.592535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e3c40-85f6-40b8-aeb1-49ab7765d730 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:04.593873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 578/1159] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:57:04.599190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce161c-8651-46ec-ba28-f6ecb0cd61ae None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:04.599598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce161c-8651-46ec-ba28-f6ecb0cd61ae None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:04.599737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce161c-8651-46ec-ba28-f6ecb0cd61ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:04.667634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9bce161c-8651-46ec-ba28-f6ecb0cd61ae None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:57:04.668841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9bce161c-8651-46ec-ba28-f6ecb0cd61ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:04.715559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:04.766172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 582/1160] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:57:05.058769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e3c40-85f6-40b8-aeb1-49ab7765d730 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:57:05.060290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b32e3c40-85f6-40b8-aeb1-49ab7765d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:05.085102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:05.163913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e3c40-85f6-40b8-aeb1-49ab7765d730 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:57:05.236726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:57:05.237256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:05.237529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:05.237831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:05.239464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:05.312167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:05.346098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:57:05.347526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c58e3-2bc5-44d5-be68-c830cc60e149 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:57:05.365694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 579/1161] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:57:07.576764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0924c-7ce7-465f-8d20-59c49c97710f None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:07.577337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0924c-7ce7-465f-8d20-59c49c97710f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:07.577337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0924c-7ce7-465f-8d20-59c49c97710f None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:07.578654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 583/1162] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:57:07.583920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5c33-b237-41c4-9c0a-926cbf28ae41 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:07.584374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5c33-b237-41c4-9c0a-926cbf28ae41 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:07.584483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5c33-b237-41c4-9c0a-926cbf28ae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:07.652179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e67d5c33-b237-41c4-9c0a-926cbf28ae41 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:57:07.653373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e67d5c33-b237-41c4-9c0a-926cbf28ae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:07.753281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 580/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:57:08.043260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0924c-7ce7-465f-8d20-59c49c97710f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:57:08.044799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c1e0924c-7ce7-465f-8d20-59c49c97710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:08.145865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0924c-7ce7-465f-8d20-59c49c97710f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:57:08.216685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:08.218143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:57:08.218958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:08.219455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:08.219908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:08.221790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:08.330049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:57:08.331476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6998a1e-22f8-402d-98a2-74e5508ab6ba service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:57:08.349441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 584/1164] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:57:10.703366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866050c-7ae6-42f1-9360-e310b36684b9 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:10.703939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866050c-7ae6-42f1-9360-e310b36684b9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:10.703939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866050c-7ae6-42f1-9360-e310b36684b9 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:10.705243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 581/1165] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:57:10.710485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef65d-70f0-4ce1-84a5-d05d1fa5c0ac None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:10.710993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef65d-70f0-4ce1-84a5-d05d1fa5c0ac None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:10.711087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef65d-70f0-4ce1-84a5-d05d1fa5c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:10.777055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-0c1ef65d-70f0-4ce1-84a5-d05d1fa5c0ac None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:57:10.778296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0c1ef65d-70f0-4ce1-84a5-d05d1fa5c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:10.829911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:10.874497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 585/1166] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:57:11.170180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866050c-7ae6-42f1-9360-e310b36684b9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:57:11.171790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5866050c-7ae6-42f1-9360-e310b36684b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:11.207372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:11.276548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866050c-7ae6-42f1-9360-e310b36684b9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:57:11.348511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:57:11.349109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:11.349380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:11.349644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:11.351238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:11.429811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:11.459006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:57:11.460428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeb8d7-bf60-43b6-bc63-b9661e9e28eb service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:57:11.478563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 582/1167] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:57:13.870028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d29d6-f100-4592-941c-0e5e9549304e None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:13.870442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d29d6-f100-4592-941c-0e5e9549304e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:13.870568 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d29d6-f100-4592-941c-0e5e9549304e None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:13.873062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 586/1168] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 05:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:57:13.877319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc8ac-5595-458d-97fd-12940e630ee9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:13.877729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc8ac-5595-458d-97fd-12940e630ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:13.877968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc8ac-5595-458d-97fd-12940e630ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:13.944522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ce4fc8ac-5595-458d-97fd-12940e630ee9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:57:13.945706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ce4fc8ac-5595-458d-97fd-12940e630ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:14.039970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 583/1169] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 05:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:57:14.324635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d29d6-f100-4592-941c-0e5e9549304e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:57:14.326235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fc8d29d6-f100-4592-941c-0e5e9549304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:14.426858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d29d6-f100-4592-941c-0e5e9549304e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:57:14.499627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:57:14.500222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:57:14.500495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:57:14.500759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:57:14.502457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:57:14.510820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:14.609361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:57:14.610730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb9f96-2911-41e9-b163-663e46a6dd5c service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:57:14.628161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 587/1170] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:57:24.038451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=82 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:24.625870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=50 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:34.670297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:34.670885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:34.670885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:34.746475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:58:34.747682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:34.843480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 584/1171] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 05:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:58:34.851471 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:34.851985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:34.852087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:34.927770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:58:34.928962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:35.023508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 588/1172] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 05:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:58:35.028470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:35.029671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:35.040937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73bb6-09cd-4877-8be7-98af76e9d137 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:35.101302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:35.135457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:35.136112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:35.136398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:35.136672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:35.137331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 05:58:35.137627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:35.138963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:58:35.138963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:58:35.138963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:58:35.139867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:35.150850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 585/1173] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 05:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 05:58:35.160955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:35.170586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40888ea3-47a7-4700-a70a-5372d3fab7d3 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:35.230787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:35.264062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:35.264663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:35.264940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:35.265211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:35.265949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:35.267041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:58:35.267041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 05:58:35.267041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 05:58:35.268264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:35.323605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 589/1174] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 05:58:35 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:58:35.327952 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:35.329466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:35.364265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f906189-7503-48d4-afd6-ccc8aec23374 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:35.459446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:35.460048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:35.460323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:35.460590 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:35.461213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:35.462247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:58:35.462247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:58:35.462247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:58:35.463438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:35.506971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 586/1175] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 05:58:35 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 05:58:35.511661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:35.513179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:35.575727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b8221-2f67-484e-abf1-2f948b8d9f1d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:35.658968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:35.670216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:35.670890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:35.671190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:35.671550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:35.672277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:35.674189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:35.688613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 590/1176] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 05:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:58:35.692797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:35.694368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:35.706255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8e2f-37a2-40b5-8b11-28f2fd7f752c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:35.731452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:35.801202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc09f1-32a1-40f7-afe6-0bbfca7855d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:35.801768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc09f1-32a1-40f7-afe6-0bbfca7855d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:35.802046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc09f1-32a1-40f7-afe6-0bbfca7855d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:35.802318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc09f1-32a1-40f7-afe6-0bbfca7855d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:35.802949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc09f1-32a1-40f7-afe6-0bbfca7855d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:35.804542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc09f1-32a1-40f7-afe6-0bbfca7855d2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:35.816520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 587/1177] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 05:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 05:58:35.820746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:35.822290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:35.855575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c086934-4dd5-452f-8595-de1e09c946bb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:35.947515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45466f-858a-446e-aadd-d38ebfcb032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:35.948759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45466f-858a-446e-aadd-d38ebfcb032e admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:35.949036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45466f-858a-446e-aadd-d38ebfcb032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:35.949304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45466f-858a-446e-aadd-d38ebfcb032e admin admin] PATH_INFO: `/v3/projects/413903ed20894d43bc4b6078a18d0be6/users/577531af01ed457b866aa3cc32877508/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:35.971502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45466f-858a-446e-aadd-d38ebfcb032e admin admin] RBAC: Authorizing `identity:create_grant(project_id=413903ed20894d43bc4b6078a18d0be6, user_id=577531af01ed457b866aa3cc32877508, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:35.974200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45466f-858a-446e-aadd-d38ebfcb032e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:35.999837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 591/1178] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 05:58:35 2022] PUT /identity/v3/projects/413903ed20894d43bc4b6078a18d0be6/users/577531af01ed457b866aa3cc32877508/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:58:36.011102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5a1a-f3d3-4a4d-a296-f5340712c6bc None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:36.011384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5a1a-f3d3-4a4d-a296-f5340712c6bc None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:36.011657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5a1a-f3d3-4a4d-a296-f5340712c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:36.070296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8bce5a1a-f3d3-4a4d-a296-f5340712c6bc None None] MFA Rules not processed for user `577531af01ed457b866aa3cc32877508`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:58:36.071396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8bce5a1a-f3d3-4a4d-a296-f5340712c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:36.147855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 588/1179] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:58:36.161652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70248-4f28-44e6-8517-d310390a785d None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:36.161964 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70248-4f28-44e6-8517-d310390a785d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:36.162231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70248-4f28-44e6-8517-d310390a785d None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:36.163580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 592/1180] 10.222.0.16 () {54 vars in 963 bytes} [Thu Oct 20 05:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:58:36.168999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80276c7d-15d2-4a88-9008-016d68cace57 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:36.169316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80276c7d-15d2-4a88-9008-016d68cace57 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:36.169594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80276c7d-15d2-4a88-9008-016d68cace57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:36.202412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:36.246616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-80276c7d-15d2-4a88-9008-016d68cace57 None None] MFA Rules not processed for user `8203173f183e4494b580181cd3647e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:58:36.247814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-80276c7d-15d2-4a88-9008-016d68cace57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:36.322085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 589/1181] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Oct 20 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 05:58:36.329944 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c70248-4f28-44e6-8517-d310390a785d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:36.331476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-73c70248-4f28-44e6-8517-d310390a785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:36.380907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:36.435783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c70248-4f28-44e6-8517-d310390a785d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:36.507025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:36.507617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:36.507891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:36.508161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:36.509728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:36.607037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:36.608372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:36.611762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:36.627183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 593/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:58:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 05:58:36.672442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757a24-0522-40cf-87a8-4e8fe432fd02 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:36.672726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757a24-0522-40cf-87a8-4e8fe432fd02 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:36.672997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757a24-0522-40cf-87a8-4e8fe432fd02 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:36.674310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 590/1183] 10.222.0.16 () {52 vars in 830 bytes} [Thu Oct 20 05:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 05:58:36.677882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:36.679080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:36.776759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ede69f-4158-4fc2-8ca4-ef05f92906ec service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:36.867081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:36.867722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:36.867880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:36.868144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] PATH_INFO: `/v3/users/577531af01ed457b866aa3cc32877508` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:36.880519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577531af01ed457b866aa3cc32877508)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:36.881522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:58:36.881522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 05:58:36.881522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 05:58:36.882771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:36.892450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:36.950738 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577531af01ed457b866aa3cc32877508'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:36.969545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577531af01ed457b866aa3cc32877508'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:36.970203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577531af01ed457b866aa3cc32877508'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:36.986305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577531af01ed457b866aa3cc32877508'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:36.986739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577531af01ed457b866aa3cc32877508'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:37.021039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 594/1184] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 05:58:36 2022] DELETE /identity/v3/users/577531af01ed457b866aa3cc32877508 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:58:37.025532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:37.026675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:37.026675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:37.085085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 05:58:37.086287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:37.161284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:37.173683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 591/1185] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 05:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 05:58:37.183757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:37.184989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:37.284479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de163072-0104-45f2-898a-a6ca8be99935 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:37.339784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:37.360084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:37.360688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:37.360972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:37.361228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:37.362866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:37.470286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:37.471626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0295b6-7f64-4e75-ad9e-1a8a4abcaf44 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:37.489294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 595/1186] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 05:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 05:58:37.830178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 05:58:37.831472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 05:58:37.843852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdb006-154d-4a36-b840-de0dd1f19cfd None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 05:58:37.945545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 05:58:37.946206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 05:58:37.946487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 05:58:37.946754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] PATH_INFO: `/v3/projects/413903ed20894d43bc4b6078a18d0be6` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 05:58:37.956490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=413903ed20894d43bc4b6078a18d0be6)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 05:58:37.957509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 05:58:37.957509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 05:58:37.957509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 05:58:37.958722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 05:58:38.021733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413903ed20894d43bc4b6078a18d0be6', 'request_id': 'req-97cf29c5-2742-46ea-a759-2d781517a80a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:38.035079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413903ed20894d43bc4b6078a18d0be6', 'request_id': 'req-97cf29c5-2742-46ea-a759-2d781517a80a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:38.044694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413903ed20894d43bc4b6078a18d0be6', 'request_id': 'req-97cf29c5-2742-46ea-a759-2d781517a80a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:38.067540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] The token cache is being invalidate because project 413903ed20894d43bc4b6078a18d0be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 05:58:38.067830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:38.068350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-97cf29c5-2742-46ea-a759-2d781517a80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 05:58:38.069649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 592/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 05:58:37 2022] DELETE /identity/v3/projects/413903ed20894d43bc4b6078a18d0be6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 05:58:47.487044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=62 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:48.065493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:00:05.980629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49809153-5a69-4488-98c2-ae80626252a1 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:05.982065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49809153-5a69-4488-98c2-ae80626252a1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:05.982364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49809153-5a69-4488-98c2-ae80626252a1 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:05.983722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 596/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 06:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:05.988678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad824c-8f01-4aab-a7e8-a5a8c4c9cf6f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:05.989125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad824c-8f01-4aab-a7e8-a5a8c4c9cf6f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:05.989272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad824c-8f01-4aab-a7e8-a5a8c4c9cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:06.069086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-61ad824c-8f01-4aab-a7e8-a5a8c4c9cf6f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:06.070325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-61ad824c-8f01-4aab-a7e8-a5a8c4c9cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:06.172040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 593/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 06:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:06.325461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49809153-5a69-4488-98c2-ae80626252a1 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:06.327624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-49809153-5a69-4488-98c2-ae80626252a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:06.448245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49809153-5a69-4488-98c2-ae80626252a1 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:06.454290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06ea66-385c-48b1-8972-1379bdd5e0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:06.454896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ea66-385c-48b1-8972-1379bdd5e0ed service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:06.455179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ea66-385c-48b1-8972-1379bdd5e0ed service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:06.455455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ea66-385c-48b1-8972-1379bdd5e0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:06.463375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06ea66-385c-48b1-8972-1379bdd5e0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:06.464971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06ea66-385c-48b1-8972-1379bdd5e0ed service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:06.474813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 597/1190] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:07.548848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4a58c-48f5-44b6-b965-7a72be941821 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:07.549423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4a58c-48f5-44b6-b965-7a72be941821 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:07.549423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4a58c-48f5-44b6-b965-7a72be941821 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:07.550754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 594/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 06:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:07.556873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e85e0-b89e-4abb-92e3-909132ce1db8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:07.557313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e85e0-b89e-4abb-92e3-909132ce1db8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:07.557425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e85e0-b89e-4abb-92e3-909132ce1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:07.577944 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ff6e85e0-b89e-4abb-92e3-909132ce1db8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:07.579126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ff6e85e0-b89e-4abb-92e3-909132ce1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:07.586833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 598/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 06:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:07.742833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4a58c-48f5-44b6-b965-7a72be941821 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:07.758513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4a58c-48f5-44b6-b965-7a72be941821 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:07.764509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2bf60-706e-4809-a5e0-02acd1735456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:07.765123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2bf60-706e-4809-a5e0-02acd1735456 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:07.765397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2bf60-706e-4809-a5e0-02acd1735456 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:07.765663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2bf60-706e-4809-a5e0-02acd1735456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:07.785096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2bf60-706e-4809-a5e0-02acd1735456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:07.786754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2bf60-706e-4809-a5e0-02acd1735456 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:07.797460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 595/1193] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:08.209261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059d0e0-6784-4134-8258-114c88cbd9e1 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:08.209491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059d0e0-6784-4134-8258-114c88cbd9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:08.209784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059d0e0-6784-4134-8258-114c88cbd9e1 None None] PATH_INFO: `/v3` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:08.211079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 599/1194] 10.222.0.13 () {54 vars in 925 bytes} [Thu Oct 20 06:00:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:00:08.217066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa183b-a627-4ba6-90bb-4f3d538aca00 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:08.217352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa183b-a627-4ba6-90bb-4f3d538aca00 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:08.217629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa183b-a627-4ba6-90bb-4f3d538aca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:08.276192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e4fa183b-a627-4ba6-90bb-4f3d538aca00 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:08.277383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e4fa183b-a627-4ba6-90bb-4f3d538aca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:08.294089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:00:08.348198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 596/1195] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Oct 20 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:11.895371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b79f-e126-4e12-8523-00a2f4d09f1e None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:11.895854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b79f-e126-4e12-8523-00a2f4d09f1e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:11.895963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b79f-e126-4e12-8523-00a2f4d09f1e None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:11.897537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 600/1196] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 06:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:11.904498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461832c-e543-4f78-9ef2-d43457a84656 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:11.904948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461832c-e543-4f78-9ef2-d43457a84656 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:11.905060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461832c-e543-4f78-9ef2-d43457a84656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:11.927472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9461832c-e543-4f78-9ef2-d43457a84656 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:11.928650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9461832c-e543-4f78-9ef2-d43457a84656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:11.939082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 597/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 06:00:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:11.946837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b79f-e126-4e12-8523-00a2f4d09f1e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:11.964103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b79f-e126-4e12-8523-00a2f4d09f1e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:11.969386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49692-eb26-4743-a7de-167a2370a4d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:11.970032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49692-eb26-4743-a7de-167a2370a4d6 service placement] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:11.970309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49692-eb26-4743-a7de-167a2370a4d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:11.970578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49692-eb26-4743-a7de-167a2370a4d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:11.979115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49692-eb26-4743-a7de-167a2370a4d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:11.980724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49692-eb26-4743-a7de-167a2370a4d6 service placement] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:11.990199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 601/1198] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:00:19.265851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b0dd-8179-40b6-8c42-1d33cf047067 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:19.266436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b0dd-8179-40b6-8c42-1d33cf047067 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:19.266436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b0dd-8179-40b6-8c42-1d33cf047067 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:19.267607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 598/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 06:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:19.273817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8168-0f5c-4229-8bd2-ee7b863e8c5e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:19.274277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8168-0f5c-4229-8bd2-ee7b863e8c5e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:19.274394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8168-0f5c-4229-8bd2-ee7b863e8c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:19.293239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1b5f8168-0f5c-4229-8bd2-ee7b863e8c5e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:19.294456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1b5f8168-0f5c-4229-8bd2-ee7b863e8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:19.302117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 602/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 06:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:19.457478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b0dd-8179-40b6-8c42-1d33cf047067 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:19.471890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b0dd-8179-40b6-8c42-1d33cf047067 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:19.477231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922772a-e31a-477d-83ff-2ec2a846b3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:19.477860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922772a-e31a-477d-83ff-2ec2a846b3ca service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:19.478164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922772a-e31a-477d-83ff-2ec2a846b3ca service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:19.478437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922772a-e31a-477d-83ff-2ec2a846b3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:19.486481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922772a-e31a-477d-83ff-2ec2a846b3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:19.488061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922772a-e31a-477d-83ff-2ec2a846b3ca service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:19.497793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 599/1201] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:20.565244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f203f5-4bd0-4d80-9063-0d3a1e2e7a21 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:20.565839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f203f5-4bd0-4d80-9063-0d3a1e2e7a21 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:20.565839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f203f5-4bd0-4d80-9063-0d3a1e2e7a21 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:20.567256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 603/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 06:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:20.573234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca129ad-38c4-4fd2-9417-ba62a757202c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:20.573661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca129ad-38c4-4fd2-9417-ba62a757202c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:20.573779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca129ad-38c4-4fd2-9417-ba62a757202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:20.594242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0ca129ad-38c4-4fd2-9417-ba62a757202c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:20.595442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0ca129ad-38c4-4fd2-9417-ba62a757202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:20.603349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 600/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 06:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:20.756534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f203f5-4bd0-4d80-9063-0d3a1e2e7a21 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:20.771601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f203f5-4bd0-4d80-9063-0d3a1e2e7a21 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:20.776978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28405af-fffc-4146-87d6-ec39ac26ced7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:20.777572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28405af-fffc-4146-87d6-ec39ac26ced7 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:20.778229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28405af-fffc-4146-87d6-ec39ac26ced7 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:20.778518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28405af-fffc-4146-87d6-ec39ac26ced7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:20.786620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28405af-fffc-4146-87d6-ec39ac26ced7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:20.788237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28405af-fffc-4146-87d6-ec39ac26ced7 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:20.797920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 604/1204] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:24.688828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072f1b-dc7e-4f20-9efb-385f2300bd2b None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:24.689395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072f1b-dc7e-4f20-9efb-385f2300bd2b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:24.689395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072f1b-dc7e-4f20-9efb-385f2300bd2b None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:24.690719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 601/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 06:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:24.695830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31275c-1c84-4211-83a3-5bd9d424aa07 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:24.696271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31275c-1c84-4211-83a3-5bd9d424aa07 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:24.696375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31275c-1c84-4211-83a3-5bd9d424aa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:24.715978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ff31275c-1c84-4211-83a3-5bd9d424aa07 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:24.717159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ff31275c-1c84-4211-83a3-5bd9d424aa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:24.724841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 605/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 06:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:00:25.015319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70072f1b-dc7e-4f20-9efb-385f2300bd2b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:25.017034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-70072f1b-dc7e-4f20-9efb-385f2300bd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:25.093724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70072f1b-dc7e-4f20-9efb-385f2300bd2b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:25.097261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463ec51-5e6e-4411-97c3-380c72ecc3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:25.097889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463ec51-5e6e-4411-97c3-380c72ecc3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:25.098171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463ec51-5e6e-4411-97c3-380c72ecc3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:25.098445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463ec51-5e6e-4411-97c3-380c72ecc3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:25.108064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463ec51-5e6e-4411-97c3-380c72ecc3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:25.109490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463ec51-5e6e-4411-97c3-380c72ecc3c1 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:25.118705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 602/1207] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:27.260551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8847b-62e4-42b4-b145-87b50e55b0cf None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:27.261070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8847b-62e4-42b4-b145-87b50e55b0cf None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:27.261070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8847b-62e4-42b4-b145-87b50e55b0cf None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:27.262611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 606/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 06:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:27.268311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e94a-c65b-471d-afab-5b4fea1d246b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:27.268775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e94a-c65b-471d-afab-5b4fea1d246b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:27.268888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e94a-c65b-471d-afab-5b4fea1d246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:27.289121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2c66e94a-c65b-471d-afab-5b4fea1d246b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:27.290333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2c66e94a-c65b-471d-afab-5b4fea1d246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:27.298674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 603/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 06:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:27.586603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8847b-62e4-42b4-b145-87b50e55b0cf None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:27.592383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=75 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:00:27.598829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8847b-62e4-42b4-b145-87b50e55b0cf None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:27.602300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45cbc-1bcc-434b-bfe1-924a87190fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:27.602885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45cbc-1bcc-434b-bfe1-924a87190fab service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:27.603158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45cbc-1bcc-434b-bfe1-924a87190fab service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:27.603421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45cbc-1bcc-434b-bfe1-924a87190fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:27.612323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45cbc-1bcc-434b-bfe1-924a87190fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:27.613731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45cbc-1bcc-434b-bfe1-924a87190fab service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:27.623567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 607/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:31.280955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff83f9-ad6a-435a-910d-9b346d3857a2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:31.281539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff83f9-ad6a-435a-910d-9b346d3857a2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:31.281539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff83f9-ad6a-435a-910d-9b346d3857a2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:31.282824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 604/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 06:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:31.288186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9581-a296-41e5-96f2-6c0111bf5093 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:31.288591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9581-a296-41e5-96f2-6c0111bf5093 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:31.288727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9581-a296-41e5-96f2-6c0111bf5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:31.309313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a71c9581-a296-41e5-96f2-6c0111bf5093 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:31.310533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a71c9581-a296-41e5-96f2-6c0111bf5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:31.318242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 608/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:31.619647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff83f9-ad6a-435a-910d-9b346d3857a2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:31.621897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-42ff83f9-ad6a-435a-910d-9b346d3857a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:31.687026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:00:31.700314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff83f9-ad6a-435a-910d-9b346d3857a2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:31.703761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944886d-e0ed-4e5c-91f1-661aca24d055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:31.704427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944886d-e0ed-4e5c-91f1-661aca24d055 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:31.704704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944886d-e0ed-4e5c-91f1-661aca24d055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:31.704973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944886d-e0ed-4e5c-91f1-661aca24d055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:31.713531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944886d-e0ed-4e5c-91f1-661aca24d055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:31.715031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944886d-e0ed-4e5c-91f1-661aca24d055 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:31.724114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 605/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:33.850142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb85c0-45be-4dd2-8007-445417a00add None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:33.850682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb85c0-45be-4dd2-8007-445417a00add None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:33.850682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb85c0-45be-4dd2-8007-445417a00add None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:33.852009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 609/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 06:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:00:33.857833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5215c5-d475-4633-a404-d245fc737b84 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:33.858252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5215c5-d475-4633-a404-d245fc737b84 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:33.858370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5215c5-d475-4633-a404-d245fc737b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:33.878029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-eb5215c5-d475-4633-a404-d245fc737b84 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:00:33.879202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eb5215c5-d475-4633-a404-d245fc737b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:33.887783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 606/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 06:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:00:34.191586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb85c0-45be-4dd2-8007-445417a00add None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:00:34.193243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-14bb85c0-45be-4dd2-8007-445417a00add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:00:34.206502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb85c0-45be-4dd2-8007-445417a00add None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:00:34.209927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf63b1a-2705-4ace-b0e2-ccb0669b7869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:00:34.210517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf63b1a-2705-4ace-b0e2-ccb0669b7869 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:00:34.210789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf63b1a-2705-4ace-b0e2-ccb0669b7869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:00:34.211055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf63b1a-2705-4ace-b0e2-ccb0669b7869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:00:34.220137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf63b1a-2705-4ace-b0e2-ccb0669b7869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:00:34.221541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf63b1a-2705-4ace-b0e2-ccb0669b7869 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:00:34.230661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 610/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:00:43.873100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=11 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:00:44.226648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=14 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:00.236995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79431-30b9-48d0-8657-b84f9ffa6008 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.237650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79431-30b9-48d0-8657-b84f9ffa6008 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.237650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79431-30b9-48d0-8657-b84f9ffa6008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.262199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb960-e69c-4876-a671-f18fd4b8d712 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.263064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb960-e69c-4876-a671-f18fd4b8d712 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.263161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb960-e69c-4876-a671-f18fd4b8d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.270989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b6c79431-30b9-48d0-8657-b84f9ffa6008 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.272217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b6c79431-30b9-48d0-8657-b84f9ffa6008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.291877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 607/1217] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.297616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ba2eb960-e69c-4876-a671-f18fd4b8d712 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.299091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ba2eb960-e69c-4876-a671-f18fd4b8d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.315445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5bb08-afc5-4bb7-9bd5-36bf5c9f785f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.315803 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5bb08-afc5-4bb7-9bd5-36bf5c9f785f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.316008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5bb08-afc5-4bb7-9bd5-36bf5c9f785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.319646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 611/1218] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:02:00.321408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864c9b-64ed-493c-95db-b1fb3a00f699 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.321698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864c9b-64ed-493c-95db-b1fb3a00f699 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.322822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864c9b-64ed-493c-95db-b1fb3a00f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.350958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6cf5bb08-afc5-4bb7-9bd5-36bf5c9f785f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.352353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6cf5bb08-afc5-4bb7-9bd5-36bf5c9f785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.356329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7c864c9b-64ed-493c-95db-b1fb3a00f699 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.357576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7c864c9b-64ed-493c-95db-b1fb3a00f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.372840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 608/1219] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.375146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfa077-42c5-4b4c-9c08-db51bf2a44b2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.375445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfa077-42c5-4b4c-9c08-db51bf2a44b2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.375723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfa077-42c5-4b4c-9c08-db51bf2a44b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.376906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 612/1220] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.380232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.380453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.380705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.426216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-73bfa077-42c5-4b4c-9c08-db51bf2a44b2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.427350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-73bfa077-42c5-4b4c-9c08-db51bf2a44b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.429154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.430348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.446202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:02:00.452029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 609/1222] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.453291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.454979 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b1ad4-3acf-440c-85c7-299ec7a664b0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.455261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b1ad4-3acf-440c-85c7-299ec7a664b0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.455534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b1ad4-3acf-440c-85c7-299ec7a664b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.481296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835dc2-5bbd-4368-ae5b-eed2a6f8007e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.494745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.495380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.495658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.495929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.496590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:00.496891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.497938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 06:02:00.497938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 06:02:00.497938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 06:02:00.499328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.502189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f17b1ad4-3acf-440c-85c7-299ec7a664b0 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.503973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f17b1ad4-3acf-440c-85c7-299ec7a664b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.523003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 614/1223] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:00.523900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.524812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 610/1224] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.526758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64695f29-d9b2-4b38-82ee-3d339762eb41 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.527145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64695f29-d9b2-4b38-82ee-3d339762eb41 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.527526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64695f29-d9b2-4b38-82ee-3d339762eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.546445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac00f17-77dd-4982-a557-b6cde1c68e2a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.554801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.555897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.558243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.558709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.559591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:00.560074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.560441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-64695f29-d9b2-4b38-82ee-3d339762eb41 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.561782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-64695f29-d9b2-4b38-82ee-3d339762eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.562459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.575573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 611/1225] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.578876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.579164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.579444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.584173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 615/1226] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:00.590581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.606131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193cc4-42fe-4a08-ae3d-42a42b3cb4d9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.610967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.613066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.614860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.615487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.615768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.616045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.617413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:00.617727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.620307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92fe7c-1754-4f49-91e2-7671e26a2f0e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.622767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 612/1227] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.623688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.633096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 616/1228] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:00.633338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718729-4870-4cbc-b802-a0ad4ffeaa13 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.635390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.635745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.636079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.639233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.639903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.640247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.640586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.641448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.642577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 06:02:00.642577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 06:02:00.642577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 06:02:00.643754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6ca0c-8e78-4dce-81bf-b3e0b88ea97e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.657018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.658281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.666512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 617/1229] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.667323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.679249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bdc96-54cc-4a82-9e4b-1ed482bc401e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.683937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.684550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 613/1230] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:00.684739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.684917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.685230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.685928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdc0a-b856-45a5-a6ca-c89cc1b7aa87 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.686154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:00.686276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdc0a-b856-45a5-a6ca-c89cc1b7aa87 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.686644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.686761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdc0a-b856-45a5-a6ca-c89cc1b7aa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.688424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.708159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 618/1231] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:00.708159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.709183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-31ecdc0a-b856-45a5-a6ca-c89cc1b7aa87 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.710419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-31ecdc0a-b856-45a5-a6ca-c89cc1b7aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.714570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05834edf-4cd4-41cf-ac4b-a4c62730d5c4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.771643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.772878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674aa8-188a-4afe-baa7-2b48a8ec152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.773484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674aa8-188a-4afe-baa7-2b48a8ec152d admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.773610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344272f-1491-4154-bacf-3516e6327749 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.773786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674aa8-188a-4afe-baa7-2b48a8ec152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.773897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344272f-1491-4154-bacf-3516e6327749 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.774067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674aa8-188a-4afe-baa7-2b48a8ec152d admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.774183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344272f-1491-4154-bacf-3516e6327749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.774708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60674aa8-188a-4afe-baa7-2b48a8ec152d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.776654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60674aa8-188a-4afe-baa7-2b48a8ec152d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.795651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1344272f-1491-4154-bacf-3516e6327749 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.796878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1344272f-1491-4154-bacf-3516e6327749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.808272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 619/1233] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:00.808491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.808491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344272f-1491-4154-bacf-3516e6327749 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.808670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6909f-aa5d-49cc-90b5-b31f0b608260 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.808670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6909f-aa5d-49cc-90b5-b31f0b608260 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.808826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6909f-aa5d-49cc-90b5-b31f0b608260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.816260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344272f-1491-4154-bacf-3516e6327749 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.828670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e1d6909f-aa5d-49cc-90b5-b31f0b608260 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.829930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e1d6909f-aa5d-49cc-90b5-b31f0b608260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.874888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.875497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.875778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.876051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.876673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.878675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.891003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 620/1235] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.892256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.892541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.892816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.908074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 616/1236] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:00.908300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:00.909320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.917465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:00.918814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:00.920129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:00.979182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669579a-820d-4196-b1e7-62dcc34f1a66 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:00.983890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1fa38-cb5b-485f-91f2-52910c84b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:00.983995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 621/1237] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:00.984283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1fa38-cb5b-485f-91f2-52910c84b605 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:00.984563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1fa38-cb5b-485f-91f2-52910c84b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:00.984806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:00.984936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1fa38-cb5b-485f-91f2-52910c84b605 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:00.985458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1fa38-cb5b-485f-91f2-52910c84b605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:00.987459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1fa38-cb5b-485f-91f2-52910c84b605 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:00.996827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d016772-9e44-4179-9de5-cf98e8fbcd6b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.002046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.002708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.003019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.003326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.003986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.005953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.011830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 617/1238] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.011830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4191e-876f-4066-b699-40d11f51b92d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.011830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4191e-876f-4066-b699-40d11f51b92d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.011830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4191e-876f-4066-b699-40d11f51b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.032205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-88b4191e-876f-4066-b699-40d11f51b92d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:01.033412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-88b4191e-876f-4066-b699-40d11f51b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:01.037917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 622/1239] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:00 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.037917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.096464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 618/1240] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:01.097808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2ba51-8eb8-4a2a-82f5-d8d0d167301e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.098696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.098979 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.099253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.102623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.103817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.104094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.104362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.104986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.106016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 06:02:01.106016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 06:02:01.106016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 06:02:01.107221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.119126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:01.120412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:01.129080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 623/1241] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.132947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 619/1242] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:01.133101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.133203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.140132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86551da1-0b1c-4ec1-9c99-7ed816d47716 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.141315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842208c-b4e5-4675-a516-ea03afd75b24 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.144920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.145548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.145803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.145930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.146122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.146393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.146671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.146763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.146941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.147577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:01.147883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.148691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.149455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.163337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 624/1243] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:01.164159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.173898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc69eb-989d-4af6-9858-55d2e49e2b22 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.179578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 620/1244] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.179578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.179776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.179776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.179776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.179776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.180395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:01.180605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.182750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.190145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c12fe6-3910-4639-b0bd-a65879f57602 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.194779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 625/1245] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:01.194898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.195405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.195505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.195685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.195959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.196642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.199418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.211828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac81830-c9d3-43e3-bb37-52b85f4d675d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.214939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 621/1246] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.214939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.217074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.217672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.217987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.218260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.218888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.220822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.223806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b6d6f-b73b-469e-8be1-8ef3d20e15f6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.228779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.229428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.229657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.229964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.230630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:01.231273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.232497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.246961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 626/1247] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.246961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.247253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:01.247253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.254724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64512-5ad6-42d9-8597-d37cc19ccac5 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.259416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.260733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.261020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.261295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.261967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.263500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599fc8-e24d-4d80-8743-0fdb62adc1e8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.263817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.268234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.268831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.269111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.269387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.270054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:01.270378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.272446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.275649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 627/1249] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.276431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.292462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 623/1250] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:01.292658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b28340-7442-4588-a29b-32612c7365cc admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.292749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.295794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.296389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.296691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.296963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.297588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.299495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.302118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624206d-08e7-437f-b46a-ceb4e9ff5393 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.306901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.307488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.307768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.308043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.308673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.310298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.320050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:01.320261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 624/1251] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.321143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.331092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 628/1252] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.331575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60a9ef-7214-4bc7-9037-a90422a04312 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.332265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.358582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:01.390829 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.391434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.391712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.391979 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.392601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.394529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.394942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2407bf-47c8-47f3-973b-6f549b0c5ecf admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.399519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.400643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.400934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.401205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.401901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.403491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.413293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 629/1253] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.414399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.424975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f249c-27e1-4a51-a7c0-6a86ffa29c2b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.429055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 625/1254] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.429055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.484936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.485466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.485762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.486059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.486703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.488372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.488572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd3e89-55a0-483e-812b-603d8ed499f2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.493274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.493910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.494196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.494541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.495171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.497066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.498103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.498907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.510098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee5d19-7fc2-4b0c-8c1a-2455f8f41f15 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.515602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.516238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.516521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.516800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.517473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.519256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.524044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 626/1256] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.524937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.532325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 631/1257] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.533525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.544377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e8be-b846-42b0-8983-5d77ea5fc0b0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.586908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73845a-abd5-4d53-a814-e96354b9e794 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.592343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.592941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.593214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.593484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.594265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.596161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.600122 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.600823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.601107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.601390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.602146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.603950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.614554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 632/1258] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.618079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.627364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 627/1259] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.627364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.627610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac546f-6e50-4825-b5c9-8bc44326dea3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.638591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:01.651962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:01.683648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.684271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.684548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.684817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.685446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.687513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.690091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadc5a2-41b3-4954-8eeb-c6c2dddf9ddf admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.694629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.695281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.695555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.695824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] PATH_INFO: `/v3/projects/7c534d26b960420faac648109bbd61a9/users/845b462237c64570a801d2de61ee25de/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.709260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 633/1260] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.710167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.711532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c534d26b960420faac648109bbd61a9, user_id=845b462237c64570a801d2de61ee25de, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.715253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.720386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d7696-e1c1-492a-815c-1dd94db8f83c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.724917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.725510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.725819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.726101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.726718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.728578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 628/1261] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:01 2022] PUT /identity/v3/projects/7c534d26b960420faac648109bbd61a9/users/845b462237c64570a801d2de61ee25de/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:01.729055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.730519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.750903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 634/1262] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.751986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.761347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d40b4-1cc2-4e43-9b80-3e2f60f0ae93 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.796149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163d7b-5961-4eeb-b6af-8639a428a482 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.800716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.801320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.801600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.801929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.802572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.804164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.814777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 629/1263] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:01.815603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.824556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.825166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.825377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1d1cc-03ea-4545-9665-a8b67a1b9d6a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.825504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.825707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.826370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.828276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.830061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.830686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.830959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.831226 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] PATH_INFO: `/v3/projects/66375c8c348c486ebcd7b8bb82c07e70/users/0de16a0b16aa4c89a9a5b142d2f846e4/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.847069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66375c8c348c486ebcd7b8bb82c07e70, user_id=0de16a0b16aa4c89a9a5b142d2f846e4, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.849708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.852971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 635/1264] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.852971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.861523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5486-aa1d-4392-99bf-36f1a6f47787 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.863818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 630/1265] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:01 2022] PUT /identity/v3/projects/66375c8c348c486ebcd7b8bb82c07e70/users/0de16a0b16aa4c89a9a5b142d2f846e4/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:01.864605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.918225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.918880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.919157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.919430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] PATH_INFO: `/v3/projects/bb8b0ff973984fe6923cb6c688801ff2/users/814226869f9446b29b879adf2444c11a/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.934271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8b0ff973984fe6923cb6c688801ff2, user_id=814226869f9446b29b879adf2444c11a, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.935696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ce2d1-0060-4860-816b-c12973359071 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:01.936924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.940269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f9aa-088e-4527-b4e2-9948edda6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:01.940868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f9aa-088e-4527-b4e2-9948edda6f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.941235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f9aa-088e-4527-b4e2-9948edda6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.941513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f9aa-088e-4527-b4e2-9948edda6f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.942169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3f9aa-088e-4527-b4e2-9948edda6f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:01.944200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3f9aa-088e-4527-b4e2-9948edda6f3e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:01.945874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:01.951860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 636/1266] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:01 2022] PUT /identity/v3/projects/bb8b0ff973984fe6923cb6c688801ff2/users/814226869f9446b29b879adf2444c11a/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:01.953133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:01.969798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 631/1267] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:01.969798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:01.969798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:01.969798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:01.983134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:01.990121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:01.992022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.031435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d19c-01c2-45fa-a31a-857f323a7f5c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.037205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.038187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.038491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.039223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.039875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.042582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.052412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 637/1268] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.053218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.057280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 632/1269] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.057280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.065566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de996d3-2171-4e67-b6dd-3929af164eea None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.067237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e01767-543e-4ce0-bf95-4fb1532fbfa3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.070237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa90a42-23b4-4402-96d4-91b810edc3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.070889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa90a42-23b4-4402-96d4-91b810edc3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.071172 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa90a42-23b4-4402-96d4-91b810edc3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.071445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa90a42-23b4-4402-96d4-91b810edc3c8 admin admin] PATH_INFO: `/v3/projects/b8337983037f49479dc679c1091b61f9/users/8ade50458d8041b28b85e3d1ab9a3eb7/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.071825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.072962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.073244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.073517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.074190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.075798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.085533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 638/1270] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.086301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa90a42-23b4-4402-96d4-91b810edc3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8337983037f49479dc679c1091b61f9, user_id=8ade50458d8041b28b85e3d1ab9a3eb7, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.086438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.089100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa90a42-23b4-4402-96d4-91b810edc3c8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.096680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3533bb-3df1-46f4-b7e3-140620d3c82b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.102389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 633/1271] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:02 2022] PUT /identity/v3/projects/b8337983037f49479dc679c1091b61f9/users/8ade50458d8041b28b85e3d1ab9a3eb7/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:02.104143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.104441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.104700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.132546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] MFA Rules not processed for user `0de16a0b16aa4c89a9a5b142d2f846e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.133912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.157651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c0fec-df2b-42f3-89e2-6fd346ea9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.158292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c0fec-df2b-42f3-89e2-6fd346ea9e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.158562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c0fec-df2b-42f3-89e2-6fd346ea9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.158833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c0fec-df2b-42f3-89e2-6fd346ea9e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.159469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c0fec-df2b-42f3-89e2-6fd346ea9e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.161075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c0fec-df2b-42f3-89e2-6fd346ea9e98 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.171757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 639/1272] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.172949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.173232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.173501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.199759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 634/1273] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.200710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.203255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] MFA Rules not processed for user `814226869f9446b29b879adf2444c11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.204474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.214421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882915c3-fe83-412b-87c3-212f9dc43e25 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.219618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.219742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.219929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.220214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.221117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.222532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.234333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 635/1274] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.235284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.247929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2551f3-66f9-4b1b-bb5d-9b0f83c6399a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.253794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.254401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.254684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.254951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.255616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.257206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.268665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 636/1275] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.269453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.280258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 640/1276] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.281002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.292772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6289-a9da-4f30-9235-192cb22ad6f3 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.297480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05ee93-2b35-4387-8800-3834125149f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.298239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05ee93-2b35-4387-8800-3834125149f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.298417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05ee93-2b35-4387-8800-3834125149f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.298652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05ee93-2b35-4387-8800-3834125149f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.299290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05ee93-2b35-4387-8800-3834125149f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.301195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05ee93-2b35-4387-8800-3834125149f3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.310885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:02.314818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 641/1277] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.316190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.316406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.316684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.337150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e2743-508a-4f34-ab10-dcb221dad206 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.338203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.339433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.341556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd777d-ce56-45b1-b6b7-46743b6e81a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.342252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd777d-ce56-45b1-b6b7-46743b6e81a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.342482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd777d-ce56-45b1-b6b7-46743b6e81a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.342752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd777d-ce56-45b1-b6b7-46743b6e81a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.347037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 642/1278] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.347817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.350744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:02.352529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd777d-ce56-45b1-b6b7-46743b6e81a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.355778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd777d-ce56-45b1-b6b7-46743b6e81a3 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.358308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c6aa-84cc-4243-bcf9-91039eac3f6e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.363045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.363555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.363831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.364097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.364803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.366389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.366525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 637/1279] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:02.367636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2706a1-b666-4554-b019-242156edd152 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.367926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2706a1-b666-4554-b019-242156edd152 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.368608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2706a1-b666-4554-b019-242156edd152 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.370818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 638/1280] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 06:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:02.371373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2706a1-b666-4554-b019-242156edd152 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.380518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 643/1281] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.380518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.388732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2706a1-b666-4554-b019-242156edd152 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.389064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b04f-5ec4-40d3-9e61-7d2c68012876 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.393813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f51e4-67bd-4756-b400-03f536a9ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.394582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f51e4-67bd-4756-b400-03f536a9ce80 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.394741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.395099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f51e4-67bd-4756-b400-03f536a9ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.395371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f51e4-67bd-4756-b400-03f536a9ce80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.395513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.395888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.396230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f51e4-67bd-4756-b400-03f536a9ce80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.396360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] PATH_INFO: `/v3/projects/4d8714934b7a4d91a4850a3e7f0ab8a9/users/4355c607584f46bd8355f6edf332fdb2/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.397936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f51e4-67bd-4756-b400-03f536a9ce80 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.412765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:02.412765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf46c3-794c-417e-8bc2-bfb4624c9661 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.412765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf46c3-794c-417e-8bc2-bfb4624c9661 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.412765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf46c3-794c-417e-8bc2-bfb4624c9661 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.416823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8714934b7a4d91a4850a3e7f0ab8a9, user_id=4355c607584f46bd8355f6edf332fdb2, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.417723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 640/1283] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 06:02:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:02.418448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf46c3-794c-417e-8bc2-bfb4624c9661 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.419994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.433947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf46c3-794c-417e-8bc2-bfb4624c9661 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.436031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 644/1284] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:02 2022] PUT /identity/v3/projects/4d8714934b7a4d91a4850a3e7f0ab8a9/users/4355c607584f46bd8355f6edf332fdb2/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:02.438885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.500582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.501804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.502047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55c899-c204-4426-a5c2-0348bc3a808e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.502211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.502425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] PATH_INFO: `/v3/projects/c0b25339712a4ac9a0b03f1c7f08a1c6/users/bd3691d5a1e4444c9a60d20ac4e76542/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.506423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2c7b-43b2-400b-909d-10de6c65008c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.507399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2c7b-43b2-400b-909d-10de6c65008c service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.507690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2c7b-43b2-400b-909d-10de6c65008c service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.509234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2c7b-43b2-400b-909d-10de6c65008c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.521252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2c7b-43b2-400b-909d-10de6c65008c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.522736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2c7b-43b2-400b-909d-10de6c65008c service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.523426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b25339712a4ac9a0b03f1c7f08a1c6, user_id=bd3691d5a1e4444c9a60d20ac4e76542, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.527616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.535244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 645/1285] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:02.536659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.536980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.537390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.547500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 641/1286] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:02 2022] PUT /identity/v3/projects/c0b25339712a4ac9a0b03f1c7f08a1c6/users/bd3691d5a1e4444c9a60d20ac4e76542/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:02.548609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.589268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.590901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.636362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6946-43fa-43e3-959a-0b07eba0ed23 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.641244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001405-a6a6-4012-bee5-a5ccb17ac9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.641942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001405-a6a6-4012-bee5-a5ccb17ac9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.642217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001405-a6a6-4012-bee5-a5ccb17ac9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.642484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001405-a6a6-4012-bee5-a5ccb17ac9a4 admin admin] PATH_INFO: `/v3/projects/7f0c4174700f433fbe8e3d59e766cbef/users/ed2a06712005416ba12560278b0adc5b/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.658250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001405-a6a6-4012-bee5-a5ccb17ac9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0c4174700f433fbe8e3d59e766cbef, user_id=ed2a06712005416ba12560278b0adc5b, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.660887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001405-a6a6-4012-bee5-a5ccb17ac9a4 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.675016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 646/1287] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.676041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 642/1288] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:02 2022] PUT /identity/v3/projects/7f0c4174700f433fbe8e3d59e766cbef/users/ed2a06712005416ba12560278b0adc5b/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:02.676270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:02.677358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6021-aa80-4dea-9194-e01850c4d651 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.677637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6021-aa80-4dea-9194-e01850c4d651 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.677929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6021-aa80-4dea-9194-e01850c4d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.691717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed460-a465-41e7-92be-7d1e042414e3 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:02.702035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9a6f6021-aa80-4dea-9194-e01850c4d651 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.703309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9a6f6021-aa80-4dea-9194-e01850c4d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.744808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:02.755288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:02.777035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04835347-9fff-4a4d-9f98-1ea31a05691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:02.777787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04835347-9fff-4a4d-9f98-1ea31a05691e admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.778104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04835347-9fff-4a4d-9f98-1ea31a05691e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.778407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04835347-9fff-4a4d-9f98-1ea31a05691e admin admin] PATH_INFO: `/v3/projects/ebacac9d6b514fd086e19481864ba1e1/users/05c69e0cc0574bfaad4f3c12c9bf9d6f/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.788390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 643/1289] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.789908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1dec9-1125-4d0b-b753-62512716f1db None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.790388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1dec9-1125-4d0b-b753-62512716f1db None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.791187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1dec9-1125-4d0b-b753-62512716f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.798297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04835347-9fff-4a4d-9f98-1ea31a05691e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebacac9d6b514fd086e19481864ba1e1, user_id=05c69e0cc0574bfaad4f3c12c9bf9d6f, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:02.801104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04835347-9fff-4a4d-9f98-1ea31a05691e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:02.818061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 647/1290] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:02 2022] PUT /identity/v3/projects/ebacac9d6b514fd086e19481864ba1e1/users/05c69e0cc0574bfaad4f3c12c9bf9d6f/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:02.819841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.820191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.820526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.823355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-91e1dec9-1125-4d0b-b753-62512716f1db None None] MFA Rules not processed for user `4355c607584f46bd8355f6edf332fdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.825021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-91e1dec9-1125-4d0b-b753-62512716f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.866165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] MFA Rules not processed for user `bd3691d5a1e4444c9a60d20ac4e76542`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.867804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.924404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 644/1291] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.926037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:02.927069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:02.927375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:02.949675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:02.950988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:02.952314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 648/1292] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:02.953346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.036685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 645/1293] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:03.037993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.129525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa19f1-8a84-411a-a532-97383e1ed2ca None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.137861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b13f-41b5-461c-afde-d5c4df4af0fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.138619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b13f-41b5-461c-afde-d5c4df4af0fd service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.138962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b13f-41b5-461c-afde-d5c4df4af0fd service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.139325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b13f-41b5-461c-afde-d5c4df4af0fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.145297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:03.177528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcae74a-1dcb-4259-b59f-1ef1626ace66 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.183799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.184555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.184840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.185120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.209858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749b13f-41b5-461c-afde-d5c4df4af0fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.211663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749b13f-41b5-461c-afde-d5c4df4af0fd service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.222865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 646/1294] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:03.227449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.228125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.228622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.253853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:03.268490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:03.269105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.269964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:03.271212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.282146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 649/1295] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:03.282972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.284763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 647/1296] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:03.285813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.294098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e9001-dd54-40a2-b00e-76a4ccc93ee9 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.298789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbfbc0-4c16-4f14-81be-f4b1da71b25f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.299017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.299622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.299898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.300170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.300796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.303045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.315384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.316596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.317017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.317379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.318463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.320812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.343714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 650/1297] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:03.344267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.350554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:03.381823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 648/1298] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:03.382309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.384977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:03.469434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bbf51-6e8b-40a6-9b7a-f3f1020e87dc admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.475488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.476368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.476949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.477608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.514892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc2039-03d2-4ad4-a62d-d27aae000430 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.532302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6542fe-c48c-4190-a4bd-c1a2005d6223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.532963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6542fe-c48c-4190-a4bd-c1a2005d6223 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.533247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6542fe-c48c-4190-a4bd-c1a2005d6223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.533547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6542fe-c48c-4190-a4bd-c1a2005d6223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.574756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.576997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.592846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 649/1299] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:03.594163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.608601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33fb60-3e74-466b-b681-4d5c2575c0d2 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.615746 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.616363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.616689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.616966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.617934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.620929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.661516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 650/1300] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:03.663118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.680909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0f22e-bcc2-4d38-8767-891b47b8e441 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.688839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6542fe-c48c-4190-a4bd-c1a2005d6223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.689710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e615fb-d8c2-4143-9054-06f2f6880705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.690381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e615fb-d8c2-4143-9054-06f2f6880705 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.690718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e615fb-d8c2-4143-9054-06f2f6880705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.690990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e615fb-d8c2-4143-9054-06f2f6880705 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.691774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e615fb-d8c2-4143-9054-06f2f6880705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.695236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6542fe-c48c-4190-a4bd-c1a2005d6223 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.695669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e615fb-d8c2-4143-9054-06f2f6880705 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.711490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:03.720490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 651/1301] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:03.721908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80c86-2d6d-40e8-b58e-bc3c65769e6a None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.722387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80c86-2d6d-40e8-b58e-bc3c65769e6a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.722670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80c86-2d6d-40e8-b58e-bc3c65769e6a None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.730710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 652/1302] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 06:02:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:03.731868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80c86-2d6d-40e8-b58e-bc3c65769e6a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.747070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80c86-2d6d-40e8-b58e-bc3c65769e6a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.747739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 651/1303] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:03.752425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.752972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbaafe-b93f-49c0-895a-e3b2ecd1f139 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.753285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.753846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.754227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.754983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.755366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbaafe-b93f-49c0-895a-e3b2ecd1f139 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.756790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.757507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbaafe-b93f-49c0-895a-e3b2ecd1f139 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.763594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 652/1304] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 06:02:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:03.767098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.767691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.768943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.782247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 653/1305] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:03.782247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.793789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b695c-fb62-433d-a401-8fe95644fe54 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.800576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0e024-638c-4259-a9e2-9f19c88fddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.801200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e024-638c-4259-a9e2-9f19c88fddae admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.801478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e024-638c-4259-a9e2-9f19c88fddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.801768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e024-638c-4259-a9e2-9f19c88fddae admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.802439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0e024-638c-4259-a9e2-9f19c88fddae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.805251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0e024-638c-4259-a9e2-9f19c88fddae admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.819677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:03.820362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 654/1306] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:03.821541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.823050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.823549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.824291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:03.850077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:03.851796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:03.917416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:03.933013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 653/1307] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:03.934501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.945083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 655/1308] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:03.946166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:03.947702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981573-4fad-4283-9b93-ffcafa60fd00 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.963313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222269a-0471-4fa5-9525-24ade7ff5d76 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:03.963508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.964286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.964573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.964970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] PATH_INFO: `/v3/projects/d24876eb64eb43b39980f3544f176df7/users/9311449efe1541e685f19249669be4e5/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.988406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:03.989051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:03.989329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:03.989613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:03.990301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.990427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24876eb64eb43b39980f3544f176df7, user_id=9311449efe1541e685f19249669be4e5, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:03.991895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:03.993480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:04.016600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 654/1309] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:03 2022] PUT /identity/v3/projects/d24876eb64eb43b39980f3544f176df7/users/9311449efe1541e685f19249669be4e5/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:04.019676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 656/1310] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:04.019787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:04.019877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:04.115448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa7ec-7997-4eaa-b55e-324b76e75cdc admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:04.125717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:04.126369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.129499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.129499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.131179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e92e6c-3d9f-4aca-b1e1-095eb05c7e22 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:04.140482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:04.141111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.142173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.143268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.284559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:04.286122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:04.300503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 655/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:04.307365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:04.312760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:04.319081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:04.320545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:04.360603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 657/1312] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:04.364725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:04.444229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2e2a-28ff-4086-a6f4-2dcbcd16e97b service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:04.455226 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:04.456212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.458478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.458908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.460240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:04.462545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:04.497352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 656/1313] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:04.498313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:04.521551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272571c5-74aa-4718-b455-e85dc2d2cc37 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:04.532935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f4287-3e7a-4515-b82c-5146a28b1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:04.533417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4287-3e7a-4515-b82c-5146a28b1a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.533719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4287-3e7a-4515-b82c-5146a28b1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.534029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4287-3e7a-4515-b82c-5146a28b1a0c admin admin] PATH_INFO: `/v3/projects/d24876eb64eb43b39980f3544f176df7/users/9311449efe1541e685f19249669be4e5/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.536638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248b82b-8b0b-4fe3-a872-4d842352b99b service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:04.539888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f4287-3e7a-4515-b82c-5146a28b1a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24876eb64eb43b39980f3544f176df7, user_id=9311449efe1541e685f19249669be4e5, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:04.546787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f4287-3e7a-4515-b82c-5146a28b1a0c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:04.548647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918bfd-1e8c-4ebd-b8ba-2bdfddabeb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:04.549325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918bfd-1e8c-4ebd-b8ba-2bdfddabeb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.549605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918bfd-1e8c-4ebd-b8ba-2bdfddabeb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.552086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918bfd-1e8c-4ebd-b8ba-2bdfddabeb5d admin admin] PATH_INFO: `/v3/projects/1a96467c5efd4c2f8f89e0ebea766aad/users/44113155fa714eeeb4429adc9c131e84/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.595317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 657/1314] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:04 2022] PUT /identity/v3/projects/d24876eb64eb43b39980f3544f176df7/users/9311449efe1541e685f19249669be4e5/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:04.600812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.601103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.602257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.610574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918bfd-1e8c-4ebd-b8ba-2bdfddabeb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a96467c5efd4c2f8f89e0ebea766aad, user_id=44113155fa714eeeb4429adc9c131e84, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:04.619071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918bfd-1e8c-4ebd-b8ba-2bdfddabeb5d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:04.640766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:04.656809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 658/1315] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:04 2022] PUT /identity/v3/projects/1a96467c5efd4c2f8f89e0ebea766aad/users/44113155fa714eeeb4429adc9c131e84/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:04.658590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:04.658924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:04.659200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:04.675710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] MFA Rules not processed for user `9311449efe1541e685f19249669be4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:04.680644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:04.720951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] MFA Rules not processed for user `44113155fa714eeeb4429adc9c131e84`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:04.723818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:04.872373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 658/1316] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:04.907127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 659/1317] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:02:04.912024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.018912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782d70-7b44-4333-93c1-2afc464b0121 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.035265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.037640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.038204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.038810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.040068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.043802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.074476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:05.096119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 659/1318] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:04 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:05.100074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.114037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f3cf-12c4-4089-add5-5899c8ce1b91 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.209556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.210399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.210896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.213316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.214499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.219756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.272317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 660/1319] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:05 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:05.277074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.280996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.307369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d7fc4-5bc2-4040-a86b-8805deefb7a8 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.323170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.323977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.324350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.324718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.325474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.327847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.355587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 661/1320] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:05.358627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.369785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94b726-2040-4c17-874c-ee62a0d9234c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.375780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.376669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.377112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.377813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.387370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f942e8-937a-454d-a2a5-a33fc6add200 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.405193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.406007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.406387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.406776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] PATH_INFO: `/v3/projects/1e822ce35c084fccb4af57862a1a889e/users/34ed130dfc40424fb652ac53a367c8fb/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.440445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e822ce35c084fccb4af57862a1a889e, user_id=34ed130dfc40424fb652ac53a367c8fb, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.443282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.476548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 662/1321] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:05 2022] PUT /identity/v3/projects/1e822ce35c084fccb4af57862a1a889e/users/34ed130dfc40424fb652ac53a367c8fb/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:05.477650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.486279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.487915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.517666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 660/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:05.598833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:05.649339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88c778-87df-455c-9c21-8d4845be4074 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.670695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd4d1d-8e3a-4cf9-8278-49c2fbbf23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.671332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4d1d-8e3a-4cf9-8278-49c2fbbf23a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.671769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4d1d-8e3a-4cf9-8278-49c2fbbf23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.672663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4d1d-8e3a-4cf9-8278-49c2fbbf23a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.673338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd4d1d-8e3a-4cf9-8278-49c2fbbf23a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.674981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd4d1d-8e3a-4cf9-8278-49c2fbbf23a7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.722403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 663/1323] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:05.724487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:05.742738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788487c-70be-427b-8302-2a95b46d88be service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:05.758971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:05.760005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.760450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.763436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] PATH_INFO: `/v3/projects/1e822ce35c084fccb4af57862a1a889e/users/34ed130dfc40424fb652ac53a367c8fb/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.767842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e822ce35c084fccb4af57862a1a889e, user_id=34ed130dfc40424fb652ac53a367c8fb, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:05.774836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:05.815429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6251372-6d20-4f08-893a-dce700e1a685 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:05.815917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6251372-6d20-4f08-893a-dce700e1a685 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:05.816744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6251372-6d20-4f08-893a-dce700e1a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:05.823987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 661/1324] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:05 2022] PUT /identity/v3/projects/1e822ce35c084fccb4af57862a1a889e/users/34ed130dfc40424fb652ac53a367c8fb/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:05.876569 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c6251372-6d20-4f08-893a-dce700e1a685 None None] MFA Rules not processed for user `34ed130dfc40424fb652ac53a367c8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:05.880195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c6251372-6d20-4f08-893a-dce700e1a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:06.070714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 664/1325] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:06.081969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:06.208738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35fca-7c9e-44c1-b113-887ca3fe1279 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:06.221107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:06.223228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:06.223572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:06.224087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:06.258011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:06.261960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:06.291383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:06.291719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:06.292015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:06.322312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 662/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:06.390248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] MFA Rules not processed for user `05c69e0cc0574bfaad4f3c12c9bf9d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:06.390248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:06.600405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:06.610156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 665/1327] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:06.699056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:06.778288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258e52-0cd1-4c14-9c41-40971c251763 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:06.794594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:06.796788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:06.798422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:06.798830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:06.799831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:06.809155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:06.901395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 663/1328] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:06 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:06.904080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:06.927476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b235fc-e94c-47c1-977b-86eb4c0be4ee None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:06.966472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:07.139168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:07.166023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211032a9-3185-4945-bc0d-34dacc7c28cb admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:07.173972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:07.174472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:07.174750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:07.175023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:07.178754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:07.179517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:07.180375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:07.184495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] PATH_INFO: `/v3/users/4355c607584f46bd8355f6edf332fdb2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:07.189674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:07.189936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4355c607584f46bd8355f6edf332fdb2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:07.190994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: WARNING py.warnings [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 06:02:07.190994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: warnings.warn(msg) Oct 20 06:02:07.190994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: Oct 20 06:02:07.191749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:07.192535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:07.283943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 666/1329] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:06 2022] POST /identity/v3/users => generated 308 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:07.288548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:07.318711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672901-2049-49bb-88d4-b47022ca6121 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:07.325298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4355c607584f46bd8355f6edf332fdb2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:07.326061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4355c607584f46bd8355f6edf332fdb2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:07.337999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:07.338896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:07.340246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:07.340693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:07.341610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:07.346749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4355c607584f46bd8355f6edf332fdb2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:07.347973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4355c607584f46bd8355f6edf332fdb2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:07.349170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:07.372914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c857bc0-ac6d-4c2a-966c-10a0f6daa7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4355c607584f46bd8355f6edf332fdb2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:07.406109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 667/1330] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:07.408173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:07.411712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:07.439420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 664/1331] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:06 2022] DELETE /identity/v3/users/4355c607584f46bd8355f6edf332fdb2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:07.446474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036364c-56d1-4fe3-8781-90ff79e8eca6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:07.447292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:07.455414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:07.455815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:07.507626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:07.510658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:07.583096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:07.583857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:07.584346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:07.584519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] PATH_INFO: `/v3/projects/570f60cc82db48f388d5e037c91c4cbe/users/3b365f86e304417e8059d3b3b277e390/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:07.620402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:07.642149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] RBAC: Authorizing `identity:create_grant(project_id=570f60cc82db48f388d5e037c91c4cbe, user_id=3b365f86e304417e8059d3b3b277e390, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:07.646083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:07.694519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 668/1332] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:07 2022] PUT /identity/v3/projects/570f60cc82db48f388d5e037c91c4cbe/users/3b365f86e304417e8059d3b3b277e390/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:07.704614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 665/1333] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:07.708147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:07.749302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:07.751988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:07.897732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de32cf4-c417-4765-abda-2510e16b415d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:07.917261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:07.919033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:07.920812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:07.922048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:07.925183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:07.944027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:07.982126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 669/1334] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:02:07.985905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:08.006444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35dd9-69d4-4ac0-aada-f9885eb45f13 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:08.031629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282853d-552c-41ef-8df1-7fdf1ae859b5 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:08.047472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:08.048422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:08.048870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:08.049208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] PATH_INFO: `/v3/projects/570f60cc82db48f388d5e037c91c4cbe/users/3b365f86e304417e8059d3b3b277e390/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:08.052731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=570f60cc82db48f388d5e037c91c4cbe, user_id=3b365f86e304417e8059d3b3b277e390, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:08.063338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:08.098837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 670/1335] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:07 2022] PUT /identity/v3/projects/570f60cc82db48f388d5e037c91c4cbe/users/3b365f86e304417e8059d3b3b277e390/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:08.100912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:08.106795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:08.113024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:08.115145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:08.115844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:08.117670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:08.137137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:08.139141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:08.163319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 666/1336] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:02:08.164509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:08.166538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:08.175247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:08.243488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b89c5-4ac6-413c-97a8-cb96e01a6d5d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:08.262851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:08.263837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:08.264201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:08.264717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] PATH_INFO: `/v3/users/0de16a0b16aa4c89a9a5b142d2f846e4` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:08.268244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de16a0b16aa4c89a9a5b142d2f846e4)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:08.272834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:08.283856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc91d67-0155-4530-9da1-a1038a1f6840 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:08.406948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de16a0b16aa4c89a9a5b142d2f846e4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:08.421902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de16a0b16aa4c89a9a5b142d2f846e4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:08.422769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de16a0b16aa4c89a9a5b142d2f846e4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:08.434758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:08.436345 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:08.437086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:08.437699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:08.440282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:08.453061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de16a0b16aa4c89a9a5b142d2f846e4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:08.453888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-792f8e30-2064-417b-a012-a4d9dc24a3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de16a0b16aa4c89a9a5b142d2f846e4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:08.456215 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:08.524517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 671/1337] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:08 2022] DELETE /identity/v3/users/0de16a0b16aa4c89a9a5b142d2f846e4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:08.529396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:08.529633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:08.530015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:08.565041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:08.568044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:08.588641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 667/1338] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:08.597123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:08.598660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:08.711149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:08.739669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:08.836910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d64e-75dc-4eec-8de5-7a805e074e74 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:08.903375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:08.904270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:08.904991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:08.905519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:08.926946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:08.928445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:08.958247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 668/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:09.814533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:09.818180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:09.855426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a509b-ce1e-4b54-afa8-e1f7e3d2d65d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:09.866312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:09.875991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:09.877767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:09.878085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] PATH_INFO: `/v3/projects/4d8714934b7a4d91a4850a3e7f0ab8a9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:09.880967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8714934b7a4d91a4850a3e7f0ab8a9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:09.887192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: WARNING py.warnings [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 06:02:09.887192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: warnings.warn(msg) Oct 20 06:02:09.887192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: Oct 20 06:02:09.893270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:10.019863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8714934b7a4d91a4850a3e7f0ab8a9', 'request_id': 'req-bc9216e2-30d7-49c4-9d27-3ea16afac809'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.046609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8714934b7a4d91a4850a3e7f0ab8a9', 'request_id': 'req-bc9216e2-30d7-49c4-9d27-3ea16afac809'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.049068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:10.064946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8714934b7a4d91a4850a3e7f0ab8a9', 'request_id': 'req-bc9216e2-30d7-49c4-9d27-3ea16afac809'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.093440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] The token cache is being invalidate because project 4d8714934b7a4d91a4850a3e7f0ab8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:10.094701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.095756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bc9216e2-30d7-49c4-9d27-3ea16afac809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.098821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 673/1341] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:09 2022] DELETE /identity/v3/projects/4d8714934b7a4d91a4850a3e7f0ab8a9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:10.103121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:10.127498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7362748-fba2-471e-92a1-8694bff76a2f service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:10.351933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:10.353225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:10.353671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:10.353984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] PATH_INFO: `/v3/users/9311449efe1541e685f19249669be4e5` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:10.355473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9311449efe1541e685f19249669be4e5)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:10.358162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:10.386138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:10.527200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9311449efe1541e685f19249669be4e5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.529019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9311449efe1541e685f19249669be4e5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.553409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9311449efe1541e685f19249669be4e5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.554736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9311449efe1541e685f19249669be4e5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.580443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9311449efe1541e685f19249669be4e5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:10.624696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 669/1342] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:10 2022] DELETE /identity/v3/users/9311449efe1541e685f19249669be4e5 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:11.053301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289b05e-0a06-4fe8-8c23-0caf8980d921 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:11.053900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289b05e-0a06-4fe8-8c23-0caf8980d921 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:11.053900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289b05e-0a06-4fe8-8c23-0caf8980d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:11.162356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a289b05e-0a06-4fe8-8c23-0caf8980d921 None None] MFA Rules not processed for user `3b365f86e304417e8059d3b3b277e390`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:11.165536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a289b05e-0a06-4fe8-8c23-0caf8980d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:11.271397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:11.272880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:11.370201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 674/1343] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:11.416058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1769e6-ddf5-4849-8d23-1c23831f5de2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:11.428372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:11.429495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:11.429976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:11.430435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] PATH_INFO: `/v3/users/814226869f9446b29b879adf2444c11a` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:11.432561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=814226869f9446b29b879adf2444c11a)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:11.435611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:11.539309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814226869f9446b29b879adf2444c11a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:11.541853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814226869f9446b29b879adf2444c11a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:11.567607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814226869f9446b29b879adf2444c11a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:11.568922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814226869f9446b29b879adf2444c11a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:11.590404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814226869f9446b29b879adf2444c11a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:11.631386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 670/1344] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:11 2022] DELETE /identity/v3/users/814226869f9446b29b879adf2444c11a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:11.636439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:11.636730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:11.637005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:11.677265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:11.678541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:11.857022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:11.905460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:11.907189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:11.942993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:11.995835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:11.997272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.021702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4746d0-fd4e-43c1-858a-7e33abcb2e49 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:12.037839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:12.038442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.038719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.038987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] PATH_INFO: `/v3/projects/d24876eb64eb43b39980f3544f176df7` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.046573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24876eb64eb43b39980f3544f176df7)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:12.049380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88594af6-4d69-4e5e-9ed8-0d5bb603de3e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:12.054713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:12.059103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:12.060022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.060464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.061585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.087729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:12.090021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:12.109189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:12.153950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24876eb64eb43b39980f3544f176df7', 'request_id': 'req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.163922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24876eb64eb43b39980f3544f176df7', 'request_id': 'req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.183108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:12.184991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.191987 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24876eb64eb43b39980f3544f176df7', 'request_id': 'req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.195307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:12.216609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] The token cache is being invalidate because project d24876eb64eb43b39980f3544f176df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:12.216906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.219792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3a00a6b6-fa64-47fb-8ce2-bca0df3d7a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.226807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 676/1347] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:11 2022] DELETE /identity/v3/projects/d24876eb64eb43b39980f3544f176df7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:12.228966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653bb8-cf89-40bb-a255-d4cf991de7e7 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:12.229145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efce83c-4294-4c12-be7f-cc518c3516b1 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.229361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efce83c-4294-4c12-be7f-cc518c3516b1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.235022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efce83c-4294-4c12-be7f-cc518c3516b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.278890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3efce83c-4294-4c12-be7f-cc518c3516b1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:12.281226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3efce83c-4294-4c12-be7f-cc518c3516b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.397378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:12.398013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.398013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.398332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] PATH_INFO: `/v3/projects/66375c8c348c486ebcd7b8bb82c07e70` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.401172 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66375c8c348c486ebcd7b8bb82c07e70)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:12.407888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:12.428912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 677/1348] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:12.439338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.439541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.439800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.488751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:12.493685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.529861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 678/1349] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:12.531952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:12.534431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66375c8c348c486ebcd7b8bb82c07e70', 'request_id': 'req-5c46212f-6663-408b-a331-a56dde772e2f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.548015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66375c8c348c486ebcd7b8bb82c07e70', 'request_id': 'req-5c46212f-6663-408b-a331-a56dde772e2f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.550447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547c75c-428a-43f9-a866-a314093234c6 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:12.563317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66375c8c348c486ebcd7b8bb82c07e70', 'request_id': 'req-5c46212f-6663-408b-a331-a56dde772e2f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.582313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] The token cache is being invalidate because project 66375c8c348c486ebcd7b8bb82c07e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:12.582592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.583284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5c46212f-6663-408b-a331-a56dde772e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:12.589088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 672/1350] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:12 2022] DELETE /identity/v3/projects/66375c8c348c486ebcd7b8bb82c07e70 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:12.590594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578906-92e7-4880-a077-7b4d0e13fc16 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.590863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578906-92e7-4880-a077-7b4d0e13fc16 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.591136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578906-92e7-4880-a077-7b4d0e13fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.636718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9c578906-92e7-4880-a077-7b4d0e13fc16 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:12.638100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9c578906-92e7-4880-a077-7b4d0e13fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.684906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:12.685288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.685571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.685978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.686635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:12.686940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:12.689526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:12.711850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:12.723386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 679/1351] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:12.724330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:12.732188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.756137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3375ae-55c7-43e6-8860-5e4330571d9b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:12.763082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 673/1352] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:12.768141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:12.769253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.769368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.769619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.770361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:12.772004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.772293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.772564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.773997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:12.811916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:12.813599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:12.832606 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 680/1353] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:12 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:12.837770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:12.840916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 674/1354] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:12.841953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:12.858831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2586-4412-4158-943f-9b2aa8f123ea None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:12.982533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:12.985579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:12.986236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:12.986521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:12.986790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:12.987822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:12.987822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:12.989846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:12.991357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ae4d7-d1a3-45b0-a0fd-cb525b4377db admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.004283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.004909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.005186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.005458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.006175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.008114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.028657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 675/1355] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:13.034357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.051997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5648a3-e1fb-4670-9286-e3bc0fe2a0c4 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.073908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 681/1356] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:12 2022] POST /identity/v3/users => generated 278 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:13.074508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.075143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.075421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.075691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.076329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.078851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.079649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.101992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3815eb-3c9d-4e48-bac4-d948386a7dfc admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.115133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.115611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.115828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.116105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.119050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.124956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.153410 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 676/1357] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:13 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:13.154688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.155783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 682/1358] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:13.157732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.172465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ee3f2-ab5f-402d-90d2-b7dc580f7aba admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.286806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.288463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.296393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc6bd0-ded5-4637-9da2-56c40574ddfd admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.298890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.299184 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.299897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.302425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.308733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.309642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.310102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.310536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.311332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.313476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.364619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:13.370651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 677/1360] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:13 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:13.371097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.377679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.393361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea152-a7d6-416c-a564-d959b72cc094 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.419304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d9d02-c0ab-40c5-ba2b-ff281ff51cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.419976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3e14-9960-4f93-9dc4-aa5f22246ab6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.421206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d9d02-c0ab-40c5-ba2b-ff281ff51cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.421676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d9d02-c0ab-40c5-ba2b-ff281ff51cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.422599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d9d02-c0ab-40c5-ba2b-ff281ff51cff admin admin] PATH_INFO: `/v3/projects/9e7c7e3123ab455ab8b515cff3fa5c22/users/6e133d3d81894c1aad664ff5ef17a023/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.438651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.439277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.439562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.439904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.440553 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.442218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.445968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d9d02-c0ab-40c5-ba2b-ff281ff51cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7c7e3123ab455ab8b515cff3fa5c22, user_id=6e133d3d81894c1aad664ff5ef17a023, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.452470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d9d02-c0ab-40c5-ba2b-ff281ff51cff admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.491935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 684/1361] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:13 2022] PUT /identity/v3/projects/9e7c7e3123ab455ab8b515cff3fa5c22/users/6e133d3d81894c1aad664ff5ef17a023/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:13.504390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.504925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.505390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.517851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:13.518986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.541100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c8f67-b612-4b59-bf8c-dfdb84da9344 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.591472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] MFA Rules not processed for user `6e133d3d81894c1aad664ff5ef17a023`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:13.593065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:13.602315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:13.761607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.762800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.764284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.765392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.767216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.771448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.793465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 679/1363] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:13.798964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.841293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303cb06-915c-44c6-8da1-3981b508b15f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.842316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 685/1364] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:13.847021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:13.864131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0282dd1-fef0-47af-8a98-1751e92f0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.866336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282dd1-fef0-47af-8a98-1751e92f0f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.866614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282dd1-fef0-47af-8a98-1751e92f0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.867053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282dd1-fef0-47af-8a98-1751e92f0f67 admin admin] PATH_INFO: `/v3/projects/1a11d57323564dac98543adb9ba2ee1e/users/94effbf43ea74661adc7d7d219f7fb18/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.877003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d64f8-af43-41b8-9875-17eb0bfb1d39 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:13.917249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0282dd1-fef0-47af-8a98-1751e92f0f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a11d57323564dac98543adb9ba2ee1e, user_id=94effbf43ea74661adc7d7d219f7fb18, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.917838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:13.918806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.919238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.919772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.920558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:13.921405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0282dd1-fef0-47af-8a98-1751e92f0f67 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.923852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:13.954394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 680/1365] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:13 2022] PUT /identity/v3/projects/1a11d57323564dac98543adb9ba2ee1e/users/94effbf43ea74661adc7d7d219f7fb18/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:13.967427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:13.967962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:13.968450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:13.998281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 686/1366] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:13 2022] POST /identity/v3/projects => generated 357 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:13.999668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.003814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:14.044753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] MFA Rules not processed for user `94effbf43ea74661adc7d7d219f7fb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:14.050355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:14.051107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:14.166890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8519fc-2bc1-43db-b8cf-7d52a567944a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.183516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.184160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.184507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.185937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.191700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:14.225810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 681/1367] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:02:14.226500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.320423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262a55-571a-4c76-bb1c-9526ab202979 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.334439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.335176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.336325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.336599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.337809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.344845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.364699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.368782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.390640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 687/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:14.392982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.418805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ad27-c9cb-47c6-9a7e-0f07b81b5934 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.430407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.430720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.430908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.431161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.435106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 682/1369] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:14 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:14.439206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.440185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.441172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.475107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700f86-2982-471b-b98b-10cd47515ea9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.500630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.501685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.502217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.502708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.503573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.507106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.521673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 688/1370] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:14 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:14.526361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.552305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 683/1371] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:14.556920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.570387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:14.578691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76253b-3f97-4d4a-87b1-4a09afd6e34e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.691704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcb9d-1022-4217-9a99-dd95ee9b578f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.707434 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.708073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.708349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.708621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.709261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.711510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.742835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.744587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.750785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.755081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] PATH_INFO: `/v3/projects/c7e457312f47494fa684820b23dd2d2c/users/392c6c2f9fb042c8a7a8a3ba257db59f/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.766709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 689/1372] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:14 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:02:14.769714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.792138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3570a7-d2a9-4c54-a5ee-9f15f9803bea admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.807262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.807901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.808178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.808736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:14.809392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.809629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e457312f47494fa684820b23dd2d2c, user_id=392c6c2f9fb042c8a7a8a3ba257db59f, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:14.812657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.819318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:14.841981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 690/1373] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:14.843091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.859836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 684/1374] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:14 2022] PUT /identity/v3/projects/c7e457312f47494fa684820b23dd2d2c/users/392c6c2f9fb042c8a7a8a3ba257db59f/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:14.864786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:14.869165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce151-1535-4d60-af8c-a1bbd7de8cb0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:14.909940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:14.968950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:14.971771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:14.972052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:14.972322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] PATH_INFO: `/v3/projects/edb79b2a6e3a42a886d7410f9e8196d7/users/7054707d77704b45bb84532af852aabc/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.037293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb79b2a6e3a42a886d7410f9e8196d7, user_id=7054707d77704b45bb84532af852aabc, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:15.047976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:15.078384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 691/1375] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:14 2022] PUT /identity/v3/projects/edb79b2a6e3a42a886d7410f9e8196d7/users/7054707d77704b45bb84532af852aabc/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:15.085798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:15.114480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af33e08-8833-4f4f-be85-295e6de566b9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:15.212985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:15.213761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.214075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.214278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.214918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:15.219384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:15.244609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 685/1376] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:02:15.246422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:15.247954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0355ed-9dfe-4ab2-a3be-0e7e1384fb03 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:15.263141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc1f5-f23b-4cb0-8dcd-27e0deb77d15 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:15.263459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:15.264061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.264332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.264608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.265258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:15.266940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:15.273275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc628b-9a06-4f8e-8f7d-c19f442ead23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:15.278126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc628b-9a06-4f8e-8f7d-c19f442ead23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.278759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc628b-9a06-4f8e-8f7d-c19f442ead23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.279332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc628b-9a06-4f8e-8f7d-c19f442ead23 admin admin] PATH_INFO: `/v3/projects/c7e457312f47494fa684820b23dd2d2c/users/392c6c2f9fb042c8a7a8a3ba257db59f/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.281948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc628b-9a06-4f8e-8f7d-c19f442ead23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e457312f47494fa684820b23dd2d2c, user_id=392c6c2f9fb042c8a7a8a3ba257db59f, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:15.286414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc628b-9a06-4f8e-8f7d-c19f442ead23 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:15.297508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 692/1377] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:15.301530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:15.302915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 686/1378] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:15 2022] PUT /identity/v3/projects/c7e457312f47494fa684820b23dd2d2c/users/392c6c2f9fb042c8a7a8a3ba257db59f/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:15.315884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.317562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.318545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.328141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53019d-be42-499f-99a9-66af08a92399 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:15.414739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] MFA Rules not processed for user `392c6c2f9fb042c8a7a8a3ba257db59f`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:15.422204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:15.435359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:15.500281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190708-2a20-4962-8dce-d896447538d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:15.500973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190708-2a20-4962-8dce-d896447538d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.501248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190708-2a20-4962-8dce-d896447538d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.501518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190708-2a20-4962-8dce-d896447538d8 admin admin] PATH_INFO: `/v3/projects/edb79b2a6e3a42a886d7410f9e8196d7/users/7054707d77704b45bb84532af852aabc/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.505191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190708-2a20-4962-8dce-d896447538d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb79b2a6e3a42a886d7410f9e8196d7, user_id=7054707d77704b45bb84532af852aabc, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:15.510342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190708-2a20-4962-8dce-d896447538d8 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:15.568683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 693/1379] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:15 2022] PUT /identity/v3/projects/edb79b2a6e3a42a886d7410f9e8196d7/users/7054707d77704b45bb84532af852aabc/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:15.570792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9ca45-4ed8-4734-8ef9-c7bbe1c90c24 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.571989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9ca45-4ed8-4734-8ef9-c7bbe1c90c24 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.572275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9ca45-4ed8-4734-8ef9-c7bbe1c90c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.663301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 687/1380] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:15.669109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:15.671395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:15.687997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3fb9ca45-4ed8-4734-8ef9-c7bbe1c90c24 None None] MFA Rules not processed for user `7054707d77704b45bb84532af852aabc`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:15.690636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3fb9ca45-4ed8-4734-8ef9-c7bbe1c90c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:15.801090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:15.839124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf31079-da2e-4d5f-9ba5-e7e7b1a5c348 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:15.910497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 694/1381] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:15.911797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.912078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.912347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:15.986451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:15.991322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:15.991833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:15.992269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.001384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] MFA Rules not processed for user `ed2a06712005416ba12560278b0adc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:16.003472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:16.161733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:16.163564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:16.175758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 688/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:16.176692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:16.199147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898f65-d233-460b-897d-1be06a69a34a service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:16.206103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:16.206911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.208914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.209316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.218467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 695/1383] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:16.219477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:16.222902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:16.235109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:16.241033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:16.243369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:16.268858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 689/1384] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:16.270951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:16.272691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:16.490874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d3e6-da2f-4c64-8f77-d4446d50a416 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:16.505950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9db4-3410-4659-9897-860c19047c20 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:16.510636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45c2d-3bc4-4fc7-a3ce-6f8acef6f8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:16.513794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45c2d-3bc4-4fc7-a3ce-6f8acef6f8ea service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.513794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45c2d-3bc4-4fc7-a3ce-6f8acef6f8ea service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.513794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45c2d-3bc4-4fc7-a3ce-6f8acef6f8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.518423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:16.519084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.519363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.519642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] PATH_INFO: `/v3/projects/bb8b0ff973984fe6923cb6c688801ff2` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.521305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8b0ff973984fe6923cb6c688801ff2)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:16.527279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:16.533994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45c2d-3bc4-4fc7-a3ce-6f8acef6f8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:16.538331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45c2d-3bc4-4fc7-a3ce-6f8acef6f8ea service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:16.588082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 690/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:16.589523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098903e5-399d-45ac-a2dd-16814a533597 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.589851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098903e5-399d-45ac-a2dd-16814a533597 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.590122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098903e5-399d-45ac-a2dd-16814a533597 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.605562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 691/1386] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:02:16 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:16.607096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098903e5-399d-45ac-a2dd-16814a533597 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:16.643919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098903e5-399d-45ac-a2dd-16814a533597 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:16.649020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8b0ff973984fe6923cb6c688801ff2', 'request_id': 'req-467ec5a9-c95b-4ae2-b7a8-555991314f64'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:16.665401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8b0ff973984fe6923cb6c688801ff2', 'request_id': 'req-467ec5a9-c95b-4ae2-b7a8-555991314f64'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:16.678480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:16.690793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8b0ff973984fe6923cb6c688801ff2', 'request_id': 'req-467ec5a9-c95b-4ae2-b7a8-555991314f64'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:16.713154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] The token cache is being invalidate because project bb8b0ff973984fe6923cb6c688801ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:16.713529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:16.714311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-467ec5a9-c95b-4ae2-b7a8-555991314f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:16.718110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:16 2022] DELETE /identity/v3/projects/bb8b0ff973984fe6923cb6c688801ff2 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:16.724926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.725220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.725570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.779809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:16.783404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:16.858524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:16.860850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.862173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.867015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:16.875632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:16.956743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:16.958475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5682d-674e-44a6-9759-3c977e385994 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:16.974504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 692/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:16.976034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0a298-aed0-4930-bea6-a701fe0b66cb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:16.976315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0a298-aed0-4930-bea6-a701fe0b66cb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:16.976587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0a298-aed0-4930-bea6-a701fe0b66cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.019559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-fac0a298-aed0-4930-bea6-a701fe0b66cb None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:17.020881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-fac0a298-aed0-4930-bea6-a701fe0b66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:17.080209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:17.091052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 697/1389] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:02:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:17.092938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:17.099002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:17.124445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:17.135783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.136370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.136946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.149157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e31521-770e-4e7c-9ddd-c9f580778114 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:17.157364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:17.158256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.158699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.159236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.164914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:17.207604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:17.209661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:17.241535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 694/1391] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:17.241535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:17.255263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:17.319923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c1858-50c4-44e3-8cf8-4a398c08ee4d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:17.342604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:17.344039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.344318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.344585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.354663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:17.356507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:17.379998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 698/1392] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:17.381154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:17.381697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:17.387872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:17.412647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 695/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:17.419289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea756f6-c897-4bc6-9902-c4fe48ba8c67 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:17.431360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:17.432201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.432664 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.433091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.434039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:17.435757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:17.440123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:17.477280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 699/1394] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:17.478900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:17.501498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6201-7808-4ab0-be56-9ee30dfce233 service placement] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:17.520064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:17.522955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.525076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.527206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.528195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:17.537867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:17.599182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 696/1395] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:17 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:17.603059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:17.619633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ba0ae-3592-4a4c-ac7c-bb8cfdd660c6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:17.811033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:17.813280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.814086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.814705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.817826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:17.826019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:17.863820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:17.921931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 700/1396] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:17 2022] POST /identity/v3/users => generated 286 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:17.924007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:17.937105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cefcc0-c21a-4e48-a299-05cfc0390c61 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:17.952711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:17.955568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:17.956065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:17.956493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:17.957351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:17.959246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:17.988355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 697/1397] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:17.990258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:18.015416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64f0b6-987a-4309-8d98-733909a4c330 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:18.027032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068b024-fc89-4cc9-a716-84b593404068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:18.028214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068b024-fc89-4cc9-a716-84b593404068 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:18.029410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068b024-fc89-4cc9-a716-84b593404068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:18.029927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068b024-fc89-4cc9-a716-84b593404068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:18.030813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068b024-fc89-4cc9-a716-84b593404068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:18.032921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068b024-fc89-4cc9-a716-84b593404068 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:18.066903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 701/1398] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:18.070985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:18.084201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f729f-07fa-48da-a9a6-34ec891ae1b7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:18.091971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:18.092938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:18.093477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:18.094393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] PATH_INFO: `/v3/projects/eeec8fec5c2245288b23bf2f04bb97f2/users/4cb7bc700b734fef8777272472241949/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:18.128185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeec8fec5c2245288b23bf2f04bb97f2, user_id=4cb7bc700b734fef8777272472241949, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:18.131308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:18.167743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 698/1399] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:18 2022] PUT /identity/v3/projects/eeec8fec5c2245288b23bf2f04bb97f2/users/4cb7bc700b734fef8777272472241949/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:18.170479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:18.170843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:18.171176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:18.238841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] MFA Rules not processed for user `4cb7bc700b734fef8777272472241949`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:18.242362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:18.492305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 702/1400] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:18.497413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:18.672092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f028-6ca6-4b5a-9f8f-3de7e1db3fb6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:18.687348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:18.688025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:18.688290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:18.688569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:18.689274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:18.697375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:18.775589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 699/1401] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:18 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:18.777733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:18.836981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0e7f1-03af-4cde-a8b3-b37a4d6c1436 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:19.038469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:19.039467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.039747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.040063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.041384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:19.042981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:19.086190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 703/1402] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:18 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:19.090565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:19.116674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904eee-6aab-45ac-b577-dc92f60128cb admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:19.134987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:19.135990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.136373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.136744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.138397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:19.140649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:19.204784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:19.216917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 700/1403] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:19.218142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:19.221282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36854ab0-b276-4116-9b05-c86195d227af admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:19.223489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.242061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7b76-60a2-4c04-80de-a1ab386fd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:19.242061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7b76-60a2-4c04-80de-a1ab386fd6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.242061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7b76-60a2-4c04-80de-a1ab386fd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.242061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7b76-60a2-4c04-80de-a1ab386fd6e2 admin admin] PATH_INFO: `/v3/projects/cbab38d345884246b95819eb456c2a8b/users/f901b3e9537743a48fedb236274a0f9a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.249453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c38fd5-e757-404c-84bf-5e86992c4b15 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:19.254740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:19.255376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.255654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.255921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] PATH_INFO: `/v3/users/bd3691d5a1e4444c9a60d20ac4e76542` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.259547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3691d5a1e4444c9a60d20ac4e76542)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:19.261508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:19.272594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7b76-60a2-4c04-80de-a1ab386fd6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbab38d345884246b95819eb456c2a8b, user_id=f901b3e9537743a48fedb236274a0f9a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:19.280756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7b76-60a2-4c04-80de-a1ab386fd6e2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:19.302937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 704/1404] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:19 2022] PUT /identity/v3/projects/cbab38d345884246b95819eb456c2a8b/users/f901b3e9537743a48fedb236274a0f9a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:19.304803 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:19.305527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85948-5f1b-48e6-82b8-d7c04a09fdbc None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.305897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85948-5f1b-48e6-82b8-d7c04a09fdbc None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.307098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85948-5f1b-48e6-82b8-d7c04a09fdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.352178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-feb85948-5f1b-48e6-82b8-d7c04a09fdbc None None] MFA Rules not processed for user `845b462237c64570a801d2de61ee25de`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:19.354851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-feb85948-5f1b-48e6-82b8-d7c04a09fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.359931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3691d5a1e4444c9a60d20ac4e76542'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:19.360753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3691d5a1e4444c9a60d20ac4e76542'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:19.385445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3691d5a1e4444c9a60d20ac4e76542'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:19.386414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3691d5a1e4444c9a60d20ac4e76542'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:19.402221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3691d5a1e4444c9a60d20ac4e76542'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:19.404165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:19.457895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 701/1405] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:19 2022] DELETE /identity/v3/users/bd3691d5a1e4444c9a60d20ac4e76542 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:19.460812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:19.461442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.522890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 705/1406] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:19.525280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ecfe-7f6f-4715-b0cf-38529be9b719 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.526859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ecfe-7f6f-4715-b0cf-38529be9b719 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.529142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ecfe-7f6f-4715-b0cf-38529be9b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.565586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-59c8ecfe-7f6f-4715-b0cf-38529be9b719 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:19.566970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-59c8ecfe-7f6f-4715-b0cf-38529be9b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.623134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dcdac-2089-4845-b59e-a7e55a2799eb admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:19.629279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c009ec-3753-4508-befc-c1bfef87b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:19.630954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c009ec-3753-4508-befc-c1bfef87b5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.631378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c009ec-3753-4508-befc-c1bfef87b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.631798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c009ec-3753-4508-befc-c1bfef87b5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.633044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c009ec-3753-4508-befc-c1bfef87b5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:19.635073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c009ec-3753-4508-befc-c1bfef87b5ba admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:19.655106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 702/1407] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:19.657230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e38bb-d64a-4363-aa5b-51202baf6d86 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.657643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e38bb-d64a-4363-aa5b-51202baf6d86 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.666981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e38bb-d64a-4363-aa5b-51202baf6d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.729009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 706/1408] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:19.729186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d75e38bb-d64a-4363-aa5b-51202baf6d86 None None] MFA Rules not processed for user `845b462237c64570a801d2de61ee25de`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:19.729699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ed003-67cb-4755-8f24-96f0f45af2b9 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.729699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ed003-67cb-4755-8f24-96f0f45af2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.729699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ed003-67cb-4755-8f24-96f0f45af2b9 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.729986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d75e38bb-d64a-4363-aa5b-51202baf6d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.730630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 707/1409] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:19.731579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ed003-67cb-4755-8f24-96f0f45af2b9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:19.746801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ed003-67cb-4755-8f24-96f0f45af2b9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:19.756574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:19.757608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.758039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.758541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] PATH_INFO: `/v3/projects/cbab38d345884246b95819eb456c2a8b/users/f901b3e9537743a48fedb236274a0f9a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.761173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbab38d345884246b95819eb456c2a8b, user_id=f901b3e9537743a48fedb236274a0f9a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:19.765026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:19.780529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 708/1410] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:19 2022] PUT /identity/v3/projects/cbab38d345884246b95819eb456c2a8b/users/f901b3e9537743a48fedb236274a0f9a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:19.781729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:19.785832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.842593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 703/1411] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:19.843868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:19.844148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:19.844417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:19.876528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:19.878064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:19.990213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:20.027672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 704/1412] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:02:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:20.028617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:20.030947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.061280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd7c7-ac47-48ce-8222-090586bdd44b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:20.076214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:20.076877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:20.077156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:20.077429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] PATH_INFO: `/v3/users/05c69e0cc0574bfaad4f3c12c9bf9d6f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:20.080859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c69e0cc0574bfaad4f3c12c9bf9d6f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:20.085129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:20.132815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1178aa-6d39-4904-a721-b4e053c58f05 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:20.137791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e275e56-bd28-4209-8bd7-26dcd2e113ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:20.138383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275e56-bd28-4209-8bd7-26dcd2e113ea service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:20.138621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275e56-bd28-4209-8bd7-26dcd2e113ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:20.139139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275e56-bd28-4209-8bd7-26dcd2e113ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:20.155947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e275e56-bd28-4209-8bd7-26dcd2e113ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:20.158090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e275e56-bd28-4209-8bd7-26dcd2e113ea service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:20.173121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 705/1413] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:20.180635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:20.180635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:20.183588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:20.195120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c69e0cc0574bfaad4f3c12c9bf9d6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:20.215007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c69e0cc0574bfaad4f3c12c9bf9d6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:20.216516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c69e0cc0574bfaad4f3c12c9bf9d6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:20.223082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:20.243006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c69e0cc0574bfaad4f3c12c9bf9d6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:20.245062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c69e0cc0574bfaad4f3c12c9bf9d6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:20.258207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] MFA Rules not processed for user `f901b3e9537743a48fedb236274a0f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:20.260067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.299501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 709/1414] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:19 2022] DELETE /identity/v3/users/05c69e0cc0574bfaad4f3c12c9bf9d6f => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:20.300377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:20.304973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.406457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 706/1415] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:20.406457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:20.406457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.437266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14acdf-2fc5-40ad-83f4-51db63996f0e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:20.482185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592955ed-2fe5-4c93-85ee-3f0473cc2926 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:20.492707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:20.493163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:20.493446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:20.493720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:20.503307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.521445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:20.522354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:20.522737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:20.523112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:20.526260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.546247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:20.548850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:20.558198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:20.581562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 707/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:20.584794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:20.589688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.655111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:20.656663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:20.685255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 710/1417] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:20.722699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2681e-3bc5-4ed8-92df-c2e2cfe05598 service placement] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:20.734428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:20.735380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:20.735669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:20.735946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:20.901095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:20.905267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:20.906402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:20.908371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:20.939219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 708/1418] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:20.948045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:20.949493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.057559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442a20-0326-4236-abe4-43f5f42db9dc service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:21.066061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:21.067438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.067775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.068060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] PATH_INFO: `/v3/projects/c0b25339712a4ac9a0b03f1c7f08a1c6` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.070154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b25339712a4ac9a0b03f1c7f08a1c6)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:21.076538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:21.120239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:21.136402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c400f0-3805-4214-adaa-54932d7acb34 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:21.159960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:21.162901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.164031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.164313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] PATH_INFO: `/v3/users/94effbf43ea74661adc7d7d219f7fb18` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.170866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=94effbf43ea74661adc7d7d219f7fb18)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:21.176747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:21.206927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b25339712a4ac9a0b03f1c7f08a1c6', 'request_id': 'req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.224814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b25339712a4ac9a0b03f1c7f08a1c6', 'request_id': 'req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.244306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b25339712a4ac9a0b03f1c7f08a1c6', 'request_id': 'req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.277115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] The token cache is being invalidate because project c0b25339712a4ac9a0b03f1c7f08a1c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:21.277418 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.280202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.284923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 711/1419] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:20 2022] DELETE /identity/v3/projects/c0b25339712a4ac9a0b03f1c7f08a1c6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:21.287795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:21.291282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.299136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94effbf43ea74661adc7d7d219f7fb18'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.300627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94effbf43ea74661adc7d7d219f7fb18'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.315116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:21.323279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94effbf43ea74661adc7d7d219f7fb18'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.325262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94effbf43ea74661adc7d7d219f7fb18'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.342681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b623c060-651d-49a4-8e56-bb82b76f86ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94effbf43ea74661adc7d7d219f7fb18'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.386274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 709/1420] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:20 2022] DELETE /identity/v3/users/94effbf43ea74661adc7d7d219f7fb18 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:21.390640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.390990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.391273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.441366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a0ca-7628-46d9-ae07-1bf5b82574d0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:21.449542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] MFA Rules not processed for user `8ade50458d8041b28b85e3d1ab9a3eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:21.450820 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.549874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:21.550888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.551260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.551628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.553683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.599326 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 710/1421] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:21.600499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:21.609094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.678166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:21.680688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a38875-69bb-4adc-af9f-f18d6acb2926 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:21.716521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 712/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:21.719877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.720356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.720771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.779714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d902037-191f-471e-9637-9324dbc1b2fa None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:21.785044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:21.789364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.794612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:21.795282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.795563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.795844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] PATH_INFO: `/v3/users/44113155fa714eeeb4429adc9c131e84` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.797207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44113155fa714eeeb4429adc9c131e84)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:21.799323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:21.820042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 713/1423] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:21.828731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:21.846870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:21.884895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c7a43-76a0-40f9-ac4a-9b87b2656d96 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:21.898185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:21.899740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:21.901286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:21.901897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] PATH_INFO: `/v3/projects/ebacac9d6b514fd086e19481864ba1e1` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:21.903976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebacac9d6b514fd086e19481864ba1e1)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:21.907142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:21.910000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:21.928048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44113155fa714eeeb4429adc9c131e84'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.929104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44113155fa714eeeb4429adc9c131e84'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.949232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44113155fa714eeeb4429adc9c131e84'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.952127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44113155fa714eeeb4429adc9c131e84'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:21.963899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:21.972717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d86ce727-663b-4ea4-93ac-cd1caabdac38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44113155fa714eeeb4429adc9c131e84'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.024095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 711/1424] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:21 2022] DELETE /identity/v3/users/44113155fa714eeeb4429adc9c131e84 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:22.027284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3302610-b045-463d-a25c-96c719504aa4 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.029852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3302610-b045-463d-a25c-96c719504aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.030140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3302610-b045-463d-a25c-96c719504aa4 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.033884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 712/1425] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 06:02:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:22.038083 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc187ba-f7a8-4af4-8047-4f98fa50f306 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.038413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebacac9d6b514fd086e19481864ba1e1', 'request_id': 'req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.042662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc187ba-f7a8-4af4-8047-4f98fa50f306 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.043118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc187ba-f7a8-4af4-8047-4f98fa50f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.051514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebacac9d6b514fd086e19481864ba1e1', 'request_id': 'req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.076578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebacac9d6b514fd086e19481864ba1e1', 'request_id': 'req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.093888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cdc187ba-f7a8-4af4-8047-4f98fa50f306 None None] MFA Rules not processed for user `8ade50458d8041b28b85e3d1ab9a3eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:22.095373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cdc187ba-f7a8-4af4-8047-4f98fa50f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.117234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] The token cache is being invalidate because project ebacac9d6b514fd086e19481864ba1e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:22.122232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.123333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.125303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 714/1426] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:21 2022] DELETE /identity/v3/projects/ebacac9d6b514fd086e19481864ba1e1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:22.129240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:22.130839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.232918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 713/1427] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:22.234688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.234688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.234988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.255778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54bb26-9ad0-425a-aa93-9b78bcb736a2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:22.366610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:22.367851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.382418 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:22.383281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.385521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.385941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.389804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.397668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 714/1428] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:02:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:22.398572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:22.400267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.642036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:22.642473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b7d3-f669-4079-b51b-74e3525f9c9c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:22.653966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:22.654467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.654751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.655028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] PATH_INFO: `/v3/users/3b365f86e304417e8059d3b3b277e390` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.657525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b365f86e304417e8059d3b3b277e390)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:22.657705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:22.659622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:22.660914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:22.697508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 715/1429] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:22.699643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:22.702641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.804737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b365f86e304417e8059d3b3b277e390'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.806761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b365f86e304417e8059d3b3b277e390'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.822931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b365f86e304417e8059d3b3b277e390'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.823834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b365f86e304417e8059d3b3b277e390'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.838568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b365f86e304417e8059d3b3b277e390'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:22.845465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:22.849216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d13ac-664d-421c-a4dd-320eecbe070f service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:22.858055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:22.859618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.860610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.862736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.867236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.878392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 715/1430] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:22 2022] DELETE /identity/v3/users/3b365f86e304417e8059d3b3b277e390 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:22.880124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:22.882058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.896760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:22.899940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788c053-cd64-41ce-8385-1b4620133275 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:22.923245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 716/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:22.931466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.932702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.933195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.964157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac92e7-1d51-4e50-8ede-36c7f8d67173 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:22.970115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:22.971174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:22.971459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:22.971737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:22.974884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.985387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] MFA Rules not processed for user `ed2a06712005416ba12560278b0adc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:22.986757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:22.994934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:22.998585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:23.017519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 716/1432] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:23.018540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:23.021424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:23.110458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 717/1433] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:23.223802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6366c-e223-420d-b25a-9fd0552965d7 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:23.238539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:23.241044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:23.241329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:23.242315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] PATH_INFO: `/v3/projects/1a96467c5efd4c2f8f89e0ebea766aad` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:23.245255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a96467c5efd4c2f8f89e0ebea766aad)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:23.255905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:23.371525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a96467c5efd4c2f8f89e0ebea766aad', 'request_id': 'req-4440416c-3354-4c2f-ab6e-b268166dbc37'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.387355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a96467c5efd4c2f8f89e0ebea766aad', 'request_id': 'req-4440416c-3354-4c2f-ab6e-b268166dbc37'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.409682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a96467c5efd4c2f8f89e0ebea766aad', 'request_id': 'req-4440416c-3354-4c2f-ab6e-b268166dbc37'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.433580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] The token cache is being invalidate because project 1a96467c5efd4c2f8f89e0ebea766aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:23.433913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.436652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.450061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 717/1434] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:23 2022] DELETE /identity/v3/projects/1a96467c5efd4c2f8f89e0ebea766aad => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:23.454216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:23.471137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:23.472922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:23.475339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d82b55-0e03-4bb9-ac75-0f2a8bb1a99f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:23.538878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:23.679652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:23.680850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:23.681140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:23.681502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] PATH_INFO: `/v3/users/34ed130dfc40424fb652ac53a367c8fb` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:23.685865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ed130dfc40424fb652ac53a367c8fb)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:23.687878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:23.738288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440416c-3354-4c2f-ab6e-b268166dbc37 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:23.757088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:23.762224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:23.767076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:23.767880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:23.768778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] PATH_INFO: `/v3/projects/1a11d57323564dac98543adb9ba2ee1e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:23.775071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a11d57323564dac98543adb9ba2ee1e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:23.778196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:23.789395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ed130dfc40424fb652ac53a367c8fb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.801337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ed130dfc40424fb652ac53a367c8fb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.802593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ed130dfc40424fb652ac53a367c8fb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.839902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ed130dfc40424fb652ac53a367c8fb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.840919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ed130dfc40424fb652ac53a367c8fb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.889372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a11d57323564dac98543adb9ba2ee1e', 'request_id': 'req-22f7feae-35b5-4109-a6be-85dda055fe56'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.905763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a11d57323564dac98543adb9ba2ee1e', 'request_id': 'req-22f7feae-35b5-4109-a6be-85dda055fe56'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.920348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 718/1435] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:23 2022] DELETE /identity/v3/users/34ed130dfc40424fb652ac53a367c8fb => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:23.925591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a11d57323564dac98543adb9ba2ee1e', 'request_id': 'req-22f7feae-35b5-4109-a6be-85dda055fe56'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.928491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:23.933491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:23.974159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] The token cache is being invalidate because project 1a11d57323564dac98543adb9ba2ee1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:23.974457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.975125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:23.988826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 718/1436] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:23 2022] DELETE /identity/v3/projects/1a11d57323564dac98543adb9ba2ee1e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:23.991459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:23.993462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.167901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7feae-35b5-4109-a6be-85dda055fe56 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:24.171006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6459f-5882-4be9-a8e5-fbeb363fa94a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:24.180182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:24.180900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.181096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:24.181312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.181590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] PATH_INFO: `/v3/projects/570f60cc82db48f388d5e037c91c4cbe` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.182965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=570f60cc82db48f388d5e037c91c4cbe)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:24.186252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:24.186545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.186999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.187284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] PATH_INFO: `/v3/users/7054707d77704b45bb84532af852aabc` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.197515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7054707d77704b45bb84532af852aabc)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:24.200204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:24.269886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570f60cc82db48f388d5e037c91c4cbe', 'request_id': 'req-d11f9b89-880a-4e66-9711-7ad7087062dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.279653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570f60cc82db48f388d5e037c91c4cbe', 'request_id': 'req-d11f9b89-880a-4e66-9711-7ad7087062dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.289596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7054707d77704b45bb84532af852aabc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.291025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7054707d77704b45bb84532af852aabc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.292172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570f60cc82db48f388d5e037c91c4cbe', 'request_id': 'req-d11f9b89-880a-4e66-9711-7ad7087062dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.292551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:24.306910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7054707d77704b45bb84532af852aabc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.308255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7054707d77704b45bb84532af852aabc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.324113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-038f3b2d-8d2a-4783-8f3e-a0e88c11c518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7054707d77704b45bb84532af852aabc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.353500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] The token cache is being invalidate because project 570f60cc82db48f388d5e037c91c4cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:24.355358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.356604 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:24.361727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 719/1437] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:23 2022] DELETE /identity/v3/projects/570f60cc82db48f388d5e037c91c4cbe => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:24.362309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:24.370848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.385266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 719/1438] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:23 2022] DELETE /identity/v3/users/7054707d77704b45bb84532af852aabc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:24.388188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb1de1-45a4-4d63-9f02-c893e5932ac3 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.391931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb1de1-45a4-4d63-9f02-c893e5932ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.392390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb1de1-45a4-4d63-9f02-c893e5932ac3 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.395783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 720/1439] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 06:02:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:24.398620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315de10-789f-45d8-9194-66bc0157ebcb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.399568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315de10-789f-45d8-9194-66bc0157ebcb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.401533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315de10-789f-45d8-9194-66bc0157ebcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.430464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:24.451296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c315de10-789f-45d8-9194-66bc0157ebcb None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:24.458657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c315de10-789f-45d8-9194-66bc0157ebcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.485268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f9b89-880a-4e66-9711-7ad7087062dc admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:24.568855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:24.570460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.570460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.570460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.573868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.596788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:24.598655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835af3a-1593-426d-a648-09b67636d2ba service placement] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:24.612794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 720/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:24.614294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.614595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.614875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.639674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:24.641147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.658335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 721/1441] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:24.670626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.671236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.671702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.725529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 721/1442] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:24.747130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:24.748285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.760496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 722/1443] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:24.763199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:24.786590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e7e3-5a0c-43b1-90a6-effb420c95d2 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:24.802848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:24.803060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:24.804127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.804292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:24.804383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.804915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.806052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:24.807033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:24.811962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:24.837411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ab2f-c9ce-418a-87c1-053cca344821 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:24.848460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 722/1444] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:24.849379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:24.858830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:24.859413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.859699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.860012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.875997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cbe87-33f3-4f25-abae-a496cdf2208a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:24.884713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:24.889568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:24.891756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:24.894266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:24.894562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:24.894843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:24.898741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:24.908454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:24.924575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 723/1445] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:24.998593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 723/1446] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:24 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:25.001693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:25.020436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e350-38bd-448c-a2be-9ef43f6f360f service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:25.116267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:25.116930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:25.117219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:25.117499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:25.120570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:25.127091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:25.164008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 724/1447] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:25 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:25.168896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:25.187560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704781-aa9d-4776-9ea1-2f1ff297e3d1 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:25.199111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:25.202988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:25.203389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:25.203674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:25.204464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:25.206185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:25.237505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 724/1448] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:25.241632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:25.255798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544d60f-8cfd-4ba7-9f52-5505b0ba27cb admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:25.267945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86b392-183a-481a-a7ed-f62811b96a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:25.268572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86b392-183a-481a-a7ed-f62811b96a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:25.268847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86b392-183a-481a-a7ed-f62811b96a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:25.269117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86b392-183a-481a-a7ed-f62811b96a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:25.273455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86b392-183a-481a-a7ed-f62811b96a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:25.280400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86b392-183a-481a-a7ed-f62811b96a00 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:25.302031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 725/1449] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:25.305968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:25.317833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da266317-aa66-4fb7-9103-11f473dea800 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:25.334627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:25.335351 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:25.335632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:25.335906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] PATH_INFO: `/v3/projects/7e8da831154c42d6813148a9d91cd909/users/7bcc79ec4da3484da74e3b7b9a16e101/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:25.382583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8da831154c42d6813148a9d91cd909, user_id=7bcc79ec4da3484da74e3b7b9a16e101, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:25.391718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:25.445400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 725/1450] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:25 2022] PUT /identity/v3/projects/7e8da831154c42d6813148a9d91cd909/users/7bcc79ec4da3484da74e3b7b9a16e101/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:25.458381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:25.458699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:25.458932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:25.548199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] MFA Rules not processed for user `7bcc79ec4da3484da74e3b7b9a16e101`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:25.549374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:25.592548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:25.673334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:25.676826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:25.711049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:25.799797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 726/1451] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:25.804691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:26.002200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167c6ed-75dd-45c3-bff5-8f1feee5483b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:26.016971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:26.017556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.017862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.018125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] PATH_INFO: `/v3/projects/1e822ce35c084fccb4af57862a1a889e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.025146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e822ce35c084fccb4af57862a1a889e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:26.030692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:26.159683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2071e0-dd14-4cec-aa1d-6011ad5867d2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:26.181137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:26.182501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.182778 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.183050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.189010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:26.197436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:26.273709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 727/1452] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:25 2022] POST /identity/v3/projects => generated 361 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:26.275306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:26.278107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:26.300043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e822ce35c084fccb4af57862a1a889e', 'request_id': 'req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.318187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e822ce35c084fccb4af57862a1a889e', 'request_id': 'req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.342423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e822ce35c084fccb4af57862a1a889e', 'request_id': 'req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.409233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] The token cache is being invalidate because project 1e822ce35c084fccb4af57862a1a889e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:26.412753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.427185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.431145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 726/1453] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:25 2022] DELETE /identity/v3/projects/1e822ce35c084fccb4af57862a1a889e => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:26.437604 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:26.440805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:26.445635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390e2b-f1b1-4e73-a23a-8464248017b5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:26.454628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:26.457529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.460723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.460723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] PATH_INFO: `/v3/projects/edb79b2a6e3a42a886d7410f9e8196d7` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.463683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb79b2a6e3a42a886d7410f9e8196d7)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:26.469389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:26.602565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:26.644334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb79b2a6e3a42a886d7410f9e8196d7', 'request_id': 'req-4e78b413-99ba-4b37-bb50-00aec780ebd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.651879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb79b2a6e3a42a886d7410f9e8196d7', 'request_id': 'req-4e78b413-99ba-4b37-bb50-00aec780ebd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.664202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6a4d-9c73-4cd7-8c8d-ed68b9b07f66 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:26.671623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb79b2a6e3a42a886d7410f9e8196d7', 'request_id': 'req-4e78b413-99ba-4b37-bb50-00aec780ebd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.693569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] The token cache is being invalidate because project edb79b2a6e3a42a886d7410f9e8196d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:26.695597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.697465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e78b413-99ba-4b37-bb50-00aec780ebd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:26.701504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 728/1454] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:26 2022] DELETE /identity/v3/projects/edb79b2a6e3a42a886d7410f9e8196d7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:26.704935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704337fa-986e-4a6f-a652-4c6541173946 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.705617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704337fa-986e-4a6f-a652-4c6541173946 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.706546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704337fa-986e-4a6f-a652-4c6541173946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.741025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-704337fa-986e-4a6f-a652-4c6541173946 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:26.742516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-704337fa-986e-4a6f-a652-4c6541173946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:26.789460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:26.838279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb8cdc-810f-4e36-8df1-a12445cad88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:26.839124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8cdc-810f-4e36-8df1-a12445cad88b admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.839780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8cdc-810f-4e36-8df1-a12445cad88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.841968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8cdc-810f-4e36-8df1-a12445cad88b admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.845605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb8cdc-810f-4e36-8df1-a12445cad88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:26.849302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb8cdc-810f-4e36-8df1-a12445cad88b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:26.912095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 729/1455] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:26.915742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384c84-65f8-41e6-88e0-c90059b77389 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.916028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384c84-65f8-41e6-88e0-c90059b77389 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.916313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384c84-65f8-41e6-88e0-c90059b77389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.927205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 727/1456] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:26 2022] POST /identity/v3/users => generated 287 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:26.933982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232b4e-fed2-4d08-9208-2e16ca85de60 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:26.933982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232b4e-fed2-4d08-9208-2e16ca85de60 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:26.934261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232b4e-fed2-4d08-9208-2e16ca85de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:26.986768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-20384c84-65f8-41e6-88e0-c90059b77389 None None] MFA Rules not processed for user `8ade50458d8041b28b85e3d1ab9a3eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:26.987877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-20384c84-65f8-41e6-88e0-c90059b77389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:27.015851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c1232b4e-fed2-4d08-9208-2e16ca85de60 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:27.015851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c1232b4e-fed2-4d08-9208-2e16ca85de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:27.065555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 728/1457] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:27.073482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.082216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.082515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.199662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:27.200837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:27.230099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 729/1458] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:27.232319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.234716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:27.243343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 730/1459] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:27.254527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.254862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.255213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.275323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b937f2-c79c-4d43-95c0-d91ec608c5d1 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.291495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.291495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.291495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.291756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.292256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.296279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:27.299372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:27.300714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:27.331826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 730/1460] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:27.342848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.343590 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 731/1461] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:27.365020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.397231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aff14-9df8-476f-9a8d-1016b970ecb9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.400717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24449a9-e73f-4384-a267-5415a8434537 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.414635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.415244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.422339 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.422962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.423275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.424674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.424674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.424863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] PATH_INFO: `/v3/projects/0ce2f0455bbf4d47883b6c19ef48cb75/users/aad0cfaa037a4d6baa2cd43232461584/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.425862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:27.426189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.428841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:27.483582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce2f0455bbf4d47883b6c19ef48cb75, user_id=aad0cfaa037a4d6baa2cd43232461584, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.484710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 731/1462] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:27.489059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.496964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:27.517558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b2d6-8fdf-4fb1-9057-47e51f6bd387 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.535302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 732/1463] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:27 2022] PUT /identity/v3/projects/0ce2f0455bbf4d47883b6c19ef48cb75/users/aad0cfaa037a4d6baa2cd43232461584/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:27.540759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.543171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.543649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.543930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.545189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.546153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:27.546466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.552489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:27.606535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 732/1464] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:27.607531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.627483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eeb162-6c1d-4ad4-b73a-b50e7f527a4c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.672926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:27.743745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8873d-f3f7-49e8-ba5d-a68c162df26f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.757806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.758968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.759314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.759586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.761818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.764029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:27.802349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.804396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.807057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.807446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.808566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.813154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:27.838572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 733/1465] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:27.839665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.843566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 733/1466] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:27 2022] POST /identity/v3/projects => generated 401 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:27.844524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:27.854442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c75236-8193-4cde-a0c2-fcc20185b847 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:27.987819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:27.989630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:27.990646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:27.992376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:27.995167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:27.998451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.012782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b4cb-c28a-4540-8cce-2f0823852bf2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.021142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.022053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.022718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.023085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] PATH_INFO: `/v3/projects/0ce2f0455bbf4d47883b6c19ef48cb75/users/aad0cfaa037a4d6baa2cd43232461584/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.035429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce2f0455bbf4d47883b6c19ef48cb75, user_id=aad0cfaa037a4d6baa2cd43232461584, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.038735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.040778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 734/1467] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:27 2022] POST /identity/v3/projects => generated 407 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:28.041543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.057092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:28.065574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 734/1468] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:27 2022] PUT /identity/v3/projects/0ce2f0455bbf4d47883b6c19ef48cb75/users/aad0cfaa037a4d6baa2cd43232461584/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:28.066664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.218551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe3cb4-6791-432f-85a9-8d812440f8c4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.247426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.249103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.249385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.249692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.250356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.253684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.253838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862ed7-3571-4be7-a3f5-cdcfa22b3d2e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.280120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637c16e-ad06-49eb-94bd-5dfde48244d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.280320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637c16e-ad06-49eb-94bd-5dfde48244d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.280628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637c16e-ad06-49eb-94bd-5dfde48244d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.280931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637c16e-ad06-49eb-94bd-5dfde48244d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.281664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637c16e-ad06-49eb-94bd-5dfde48244d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.284043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637c16e-ad06-49eb-94bd-5dfde48244d7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.320671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 735/1469] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:28 2022] POST /identity/v3/users => generated 304 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:28.325511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.325823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.326109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.376085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 735/1470] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:28 2022] POST /identity/v3/users => generated 301 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:28.376784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.400920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] MFA Rules not processed for user `aad0cfaa037a4d6baa2cd43232461584`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:28.402682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:28.413247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e66aa6-6204-42c0-a796-808e3751b168 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.424583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.425225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.426562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.426696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.441669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.444827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.466389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 736/1471] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:28.467296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.511344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea432-559e-4154-9eff-5698575b1f70 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.522857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.523492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.523769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.524710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.525392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.529607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.588632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 737/1472] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:28.589517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.601921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612a0d8-ed20-4ea1-8beb-5676f7ca4369 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.607586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:28.625668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.628049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.629182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.632577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.634389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.641915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.697796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 736/1473] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:28.702675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 738/1474] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:28.707629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.720232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.749013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f30b6-3e53-4307-b20d-27c04d7c9348 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.764395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347665-0e91-45bd-831f-d93e5f2312eb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:28.775405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.776083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.776362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.776647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] PATH_INFO: `/v3/projects/fc307c39ef294819aa68ffb8f24c3566/users/359c9fcda1074ed2b1ed75ce660cfcb9/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.780357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:28.781901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:28.782507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:28.782980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:28.783824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.787487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.809487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 737/1475] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:28.813725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:28.819541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:28.832848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc307c39ef294819aa68ffb8f24c3566, user_id=359c9fcda1074ed2b1ed75ce660cfcb9, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:28.855549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:28.899717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 739/1476] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:28 2022] PUT /identity/v3/projects/fc307c39ef294819aa68ffb8f24c3566/users/359c9fcda1074ed2b1ed75ce660cfcb9/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:28.904677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:29.061558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bb5e2-6745-45a6-8589-7a39745636d1 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:29.199613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678646-2943-4d0d-8530-074c2b0f6843 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:29.213698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae651a-dd96-4138-b77c-774717262784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:29.214410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae651a-dd96-4138-b77c-774717262784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:29.214687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae651a-dd96-4138-b77c-774717262784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:29.214968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae651a-dd96-4138-b77c-774717262784 admin admin] PATH_INFO: `/v3/projects/04583416a486488fa29aa1cbfef3c29f/users/6627f289eb37485bad050b81cadee2d2/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:29.270189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f327-3b7c-426f-a6cf-88d0b07dff10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:29.271019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f327-3b7c-426f-a6cf-88d0b07dff10 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:29.271256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f327-3b7c-426f-a6cf-88d0b07dff10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:29.271552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f327-3b7c-426f-a6cf-88d0b07dff10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:29.273410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae651a-dd96-4138-b77c-774717262784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04583416a486488fa29aa1cbfef3c29f, user_id=6627f289eb37485bad050b81cadee2d2, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:29.282462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae651a-dd96-4138-b77c-774717262784 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:29.316451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 740/1477] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:28 2022] PUT /identity/v3/projects/04583416a486488fa29aa1cbfef3c29f/users/6627f289eb37485bad050b81cadee2d2/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:29.317713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625b27-f3d5-4d0d-931a-fa1227c5a6f3 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:29.318240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625b27-f3d5-4d0d-931a-fa1227c5a6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:29.318544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625b27-f3d5-4d0d-931a-fa1227c5a6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:29.483128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-74625b27-f3d5-4d0d-931a-fa1227c5a6f3 None None] MFA Rules not processed for user `359c9fcda1074ed2b1ed75ce660cfcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:29.484352 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-74625b27-f3d5-4d0d-931a-fa1227c5a6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:29.488142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f327-3b7c-426f-a6cf-88d0b07dff10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:29.490219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f327-3b7c-426f-a6cf-88d0b07dff10 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:29.546576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:29.581861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 738/1478] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:29.583810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:29.584541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:29.587057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:29.730419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] MFA Rules not processed for user `6627f289eb37485bad050b81cadee2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:29.732036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:29.760128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 741/1479] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:29.766772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:29.768913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:29.771674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:29.820212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:29.955147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:29.960536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:30.030087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 739/1480] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:29 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:30.035450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:30.153812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065ac38-f5e6-4949-9bd9-b3936123d4fa None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:30.158510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:30.159437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:30.160122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:30.160703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:30.162054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:30.165353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:30.192748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 742/1481] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:02:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:30.194322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:30.205916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:30.219178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 740/1482] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:30 2022] POST /identity/v3/projects => generated 409 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:30.229121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:30.390442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637c75-d665-4419-aedb-c75cc8c420a4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:30.449205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae4f04-4014-4a8d-9d58-906fb7e3ba3a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:30.484972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:30.488584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:30.488997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:30.490303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:30.493308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:30.508144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:30.576984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:30.622722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 741/1483] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:30 2022] POST /identity/v3/projects => generated 399 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:30.624588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:30.642550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:30.643763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:30.645733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:30.646162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:30.650795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:30.766432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:30.844547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb7d9a-e15b-4c1a-9c0a-8d34ce078851 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:30.860830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:30.861470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:30.861816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:30.862043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:30.864038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:30.865802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:30.869680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:30.870770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:30.926596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 743/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:30.928982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:30.939877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:30.982098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 742/1485] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:30 2022] POST /identity/v3/users => generated 311 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:30.987122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.017038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428971-fcf0-47ef-a28b-a1f36df7786d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.029644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.030551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.031996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.032472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.035208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.039062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.103017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 743/1486] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:30 2022] POST /identity/v3/users => generated 306 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:31.104177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.154162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38341931-6b57-4c75-b546-faeba2d4f119 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.170105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.170880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.171167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.171490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.172266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.187882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605bc09-6be5-497b-b338-0a4980edce54 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.191142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.235745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 744/1487] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:31.236661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.284846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2afed-5b97-47b0-bf94-1f2095c32f8a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.299627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.300895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.301319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.301855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.302709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.305136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.320573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 745/1488] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:31.320573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.330942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eea877-7971-4fab-be7e-60ae6164daaf admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.336987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.338064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.338372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.338668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] PATH_INFO: `/v3/projects/4f30763f9e714a3ba8da323ef820dbca/users/8ec46658eea9422d9b36b0f93656ceb0/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.366770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.368626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.369238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.370001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.371946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f30763f9e714a3ba8da323ef820dbca, user_id=8ec46658eea9422d9b36b0f93656ceb0, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.375974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.391305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:31.396571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 746/1489] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:31 2022] PUT /identity/v3/projects/4f30763f9e714a3ba8da323ef820dbca/users/8ec46658eea9422d9b36b0f93656ceb0/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:31.399396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.516672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.520567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.544186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 744/1490] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:02:31.545934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.571813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30816-92cc-46f7-aa9b-e6fbd193fb08 service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.579130 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.580187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.580669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.581318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.595068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766900a-fc49-4e0b-90dc-cd551f5af35d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.597449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.604100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.615051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.615792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.624559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.625368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] PATH_INFO: `/v3/projects/81daa5a3f45d44d59791cc425f2d2ef8/users/32fd9d64a07f4cef82669aed801e8e26/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.643261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 745/1491] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:31.644390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.665617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81daa5a3f45d44d59791cc425f2d2ef8, user_id=32fd9d64a07f4cef82669aed801e8e26, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.673607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.699702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9dc5-01c6-4f2e-a2dc-5f7e3d8e6979 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:31.720721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6964a6-46c4-49f8-afca-375eed55003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:31.723651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6964a6-46c4-49f8-afca-375eed55003c admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.723991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6964a6-46c4-49f8-afca-375eed55003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.724278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6964a6-46c4-49f8-afca-375eed55003c admin admin] PATH_INFO: `/v3/projects/4f30763f9e714a3ba8da323ef820dbca/users/8ec46658eea9422d9b36b0f93656ceb0/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.726749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 747/1492] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:31 2022] PUT /identity/v3/projects/81daa5a3f45d44d59791cc425f2d2ef8/users/32fd9d64a07f4cef82669aed801e8e26/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:31.732010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6964a6-46c4-49f8-afca-375eed55003c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f30763f9e714a3ba8da323ef820dbca, user_id=8ec46658eea9422d9b36b0f93656ceb0, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:31.734041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:31.738194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6964a6-46c4-49f8-afca-375eed55003c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:31.770381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 746/1493] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:31 2022] PUT /identity/v3/projects/4f30763f9e714a3ba8da323ef820dbca/users/8ec46658eea9422d9b36b0f93656ceb0/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:31.785139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:31.785679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:31.785947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:31.859065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] MFA Rules not processed for user `8ec46658eea9422d9b36b0f93656ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:31.861586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:31.960221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:32.041675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ce082-ac79-4299-99c7-48a38c4b1267 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:32.075530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 747/1494] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:32.085541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:32.193063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:32.193941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.194448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.194773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:32.195953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:32.200395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:32.230342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 748/1495] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:32.232849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:32.266219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8690c-9faa-486e-a3be-60cf0c919b3a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:32.279773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f64a56-994b-42b5-a29d-4c11cb912251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:32.280551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f64a56-994b-42b5-a29d-4c11cb912251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.280835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f64a56-994b-42b5-a29d-4c11cb912251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.281110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f64a56-994b-42b5-a29d-4c11cb912251 admin admin] PATH_INFO: `/v3/projects/81daa5a3f45d44d59791cc425f2d2ef8/users/32fd9d64a07f4cef82669aed801e8e26/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:32.290964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f64a56-994b-42b5-a29d-4c11cb912251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81daa5a3f45d44d59791cc425f2d2ef8, user_id=32fd9d64a07f4cef82669aed801e8e26, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:32.300221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1401e88-4355-414d-ba19-dcc2e1536c85 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:32.304278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f64a56-994b-42b5-a29d-4c11cb912251 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:32.317070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaaf25-1216-4746-a017-8e960fc99ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:32.319932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaaf25-1216-4746-a017-8e960fc99ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.320210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaaf25-1216-4746-a017-8e960fc99ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.323174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaaf25-1216-4746-a017-8e960fc99ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:32.338011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 749/1496] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:32 2022] PUT /identity/v3/projects/81daa5a3f45d44d59791cc425f2d2ef8/users/32fd9d64a07f4cef82669aed801e8e26/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:32.339665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.339950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.340222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:32.357928 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaaf25-1216-4746-a017-8e960fc99ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:32.366831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaaf25-1216-4746-a017-8e960fc99ca2 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:32.386239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 748/1497] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:32.388280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.388701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.388820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:32.426893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:32.428745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:32.471438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] MFA Rules not processed for user `32fd9d64a07f4cef82669aed801e8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:32.472664 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:32.498097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:32.584473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 750/1498] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Oct 20 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:32.644697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 749/1499] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:32.712730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:32.714278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:32.731827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee184-d45a-4e0b-a6a1-7c6eb0d1d683 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:32.753364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:32.754469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.754785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.755332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:32.775500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:32.777037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:32.796599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 751/1500] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:32.843588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:32.975653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea968f2-c114-4393-9d3b-3aa93334cee1 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:32.984629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:32.985272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:32.985554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:32.985887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:33.007891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:33.011580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:33.038549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 750/1501] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:33.107712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:33.130517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceed626-8bf4-45bd-9705-41eb419dc5c7 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:33.145899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037b3a5-ef7f-469f-b351-0d7d418cd215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:33.146531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037b3a5-ef7f-469f-b351-0d7d418cd215 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:33.146896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037b3a5-ef7f-469f-b351-0d7d418cd215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:33.147347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037b3a5-ef7f-469f-b351-0d7d418cd215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:33.261679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037b3a5-ef7f-469f-b351-0d7d418cd215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:33.263800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037b3a5-ef7f-469f-b351-0d7d418cd215 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:33.275296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 752/1502] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:33.989497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:34.003182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a98b-c45e-46d8-825d-3994700c1e24 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:34.018349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2d2b8-2f7e-4fc1-a02c-8baf94a11b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:34.019072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d2b8-2f7e-4fc1-a02c-8baf94a11b0f service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:34.019558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d2b8-2f7e-4fc1-a02c-8baf94a11b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:34.020118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d2b8-2f7e-4fc1-a02c-8baf94a11b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:34.157780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d2b8-2f7e-4fc1-a02c-8baf94a11b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:34.160272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d2b8-2f7e-4fc1-a02c-8baf94a11b0f service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:34.182785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 751/1503] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:02:34.968528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734bb0-3558-44a7-95d1-33762d7f2a54 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:34.969050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734bb0-3558-44a7-95d1-33762d7f2a54 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:34.969131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734bb0-3558-44a7-95d1-33762d7f2a54 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:34.972987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 753/1504] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:02:34 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:35.040899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:35.041992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:35.042454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:35.125499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:35.134098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:35.262608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:35.340126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 752/1505] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:02:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:36.072690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734bb0-3558-44a7-95d1-33762d7f2a54 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:36.074758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-62734bb0-3558-44a7-95d1-33762d7f2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:36.134350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734bb0-3558-44a7-95d1-33762d7f2a54 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:36.156720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea92c-73f4-42a2-8b88-46613b110e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:36.157436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea92c-73f4-42a2-8b88-46613b110e09 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:36.157815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea92c-73f4-42a2-8b88-46613b110e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:36.158112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea92c-73f4-42a2-8b88-46613b110e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:36.171015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:36.187691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea92c-73f4-42a2-8b88-46613b110e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:36.189316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea92c-73f4-42a2-8b88-46613b110e09 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:36.218860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 754/1506] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:39.397189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:39.399951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:39.524151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d452d68-34f2-4698-bf9a-cb6035fc9941 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:39.531178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:39.531178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:39.531178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:39.531178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] PATH_INFO: `/v3/users/6e133d3d81894c1aad664ff5ef17a023` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:39.532633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e133d3d81894c1aad664ff5ef17a023)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:39.535272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:39.687872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e133d3d81894c1aad664ff5ef17a023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:39.704438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e133d3d81894c1aad664ff5ef17a023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:39.706214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e133d3d81894c1aad664ff5ef17a023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:39.725079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e133d3d81894c1aad664ff5ef17a023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:39.725858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e133d3d81894c1aad664ff5ef17a023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:39.757638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 753/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:39 2022] DELETE /identity/v3/users/6e133d3d81894c1aad664ff5ef17a023 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:39.761135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:39.761652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:39.761954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:39.808722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:39.810202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:39.941143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 755/1508] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:39.942408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:39.944505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:40.067820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398ffa-3092-495b-8d66-65abea346f26 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:40.072976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6f9a-2d88-4af6-a31e-f51ecdd5117e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:40.073926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6f9a-2d88-4af6-a31e-f51ecdd5117e service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:40.074453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6f9a-2d88-4af6-a31e-f51ecdd5117e service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:40.074899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6f9a-2d88-4af6-a31e-f51ecdd5117e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:40.102197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed6f9a-2d88-4af6-a31e-f51ecdd5117e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:40.105114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed6f9a-2d88-4af6-a31e-f51ecdd5117e service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:40.122269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:40.141831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 754/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:40.165044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:40.166881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:40.192971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238ee68-bb90-4b69-95fa-d0da53df0dbb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:40.207058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6dfaa-b202-4040-9fbc-d62c893c151a None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:40.211892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6dfaa-b202-4040-9fbc-d62c893c151a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:40.211892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6dfaa-b202-4040-9fbc-d62c893c151a None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:40.212316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:40.212316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:40.212316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:40.212316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] PATH_INFO: `/v3/users/6627f289eb37485bad050b81cadee2d2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:40.212704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 755/1510] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:02:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 06:02:40.215830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6627f289eb37485bad050b81cadee2d2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:40.240096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:40.240096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:40.240096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:40.240348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:40.312822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:40.319463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:40.496203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6627f289eb37485bad050b81cadee2d2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:40.497703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6627f289eb37485bad050b81cadee2d2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:40.546157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6627f289eb37485bad050b81cadee2d2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:40.550136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6627f289eb37485bad050b81cadee2d2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:40.589494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e7054cd-7b74-40da-a2ca-bdcca422507a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6627f289eb37485bad050b81cadee2d2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:40.648095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 756/1511] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:40 2022] DELETE /identity/v3/users/6627f289eb37485bad050b81cadee2d2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:40.650992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:40.651278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:40.651970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:40.662594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 756/1512] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:02:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:40.721936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:40.725236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:40.868362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 757/1513] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:40.888139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:40.891757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:40.935373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:40.938135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:40.948180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076800-e5d5-452f-94e1-7682654d6d35 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:40.962067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:40.966277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:40.968227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:40.968885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:40.969712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] PATH_INFO: `/v3/users/7bcc79ec4da3484da74e3b7b9a16e101` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:40.971687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcc79ec4da3484da74e3b7b9a16e101)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:40.975893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:41.074670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcc79ec4da3484da74e3b7b9a16e101'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.089069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcc79ec4da3484da74e3b7b9a16e101'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.090118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcc79ec4da3484da74e3b7b9a16e101'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.096831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60834ac-572d-46c6-a310-97267e7811a0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:41.110392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcc79ec4da3484da74e3b7b9a16e101'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.123529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a0c88fba-5e8d-4405-9114-165b0151a2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcc79ec4da3484da74e3b7b9a16e101'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.142875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:41.143140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:41.143397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:41.143638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:41.147596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:41.163971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:41.166229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:41.176918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 757/1514] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:40 2022] DELETE /identity/v3/users/7bcc79ec4da3484da74e3b7b9a16e101 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:41.182691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:41.182985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:41.183417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:41.187922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 758/1515] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:41.218652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:41.219919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:41.379285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 758/1516] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:41.443213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:41.444923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:41.465552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e85eb-5e59-427a-bbba-0ac122afdcee service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:41.566402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:41.567998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:41.578773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:41.592556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab933d-7ac2-49f8-90a4-d2846c38a679 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:41.618028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:41.618028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:41.618028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:41.618028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] PATH_INFO: `/v3/projects/9e7c7e3123ab455ab8b515cff3fa5c22` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:41.618337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7c7e3123ab455ab8b515cff3fa5c22)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:41.618337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:41.686184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:41.687562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:41.688091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:41.688614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:41.706537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:41.708639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:41.735792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7c7e3123ab455ab8b515cff3fa5c22', 'request_id': 'req-bb6fed62-945b-4918-b351-8dd4202c973e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.739453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 759/1517] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:41.740815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:41.746055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:41.753649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7c7e3123ab455ab8b515cff3fa5c22', 'request_id': 'req-bb6fed62-945b-4918-b351-8dd4202c973e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.773832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7c7e3123ab455ab8b515cff3fa5c22', 'request_id': 'req-bb6fed62-945b-4918-b351-8dd4202c973e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.809645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] The token cache is being invalidate because project 9e7c7e3123ab455ab8b515cff3fa5c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:41.814985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.817413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:41.829147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 759/1518] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:41 2022] DELETE /identity/v3/projects/9e7c7e3123ab455ab8b515cff3fa5c22 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:41.833149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:41.840222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.078329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab3054-0dd0-484c-abe4-123bd3b806ed service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:42.114624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fed62-945b-4918-b351-8dd4202c973e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:42.119934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:42.120743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:42.121031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:42.121312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] PATH_INFO: `/v3/users/392c6c2f9fb042c8a7a8a3ba257db59f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:42.122521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392c6c2f9fb042c8a7a8a3ba257db59f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:42.124732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:42.251698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:42.262680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392c6c2f9fb042c8a7a8a3ba257db59f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.274428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392c6c2f9fb042c8a7a8a3ba257db59f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.275602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392c6c2f9fb042c8a7a8a3ba257db59f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.288270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:42.290573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392c6c2f9fb042c8a7a8a3ba257db59f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.290847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:42.291926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:42.292665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392c6c2f9fb042c8a7a8a3ba257db59f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.293101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:42.297246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.354406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 760/1519] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:41 2022] DELETE /identity/v3/users/392c6c2f9fb042c8a7a8a3ba257db59f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:42.357281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:42.361526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.366710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:42.369370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:42.389275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:42.392675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 760/1520] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:42.514896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:42.516541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.545103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c981ab-f9ed-4b2e-9431-11134e886437 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:42.553769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:42.556758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:42.557765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:42.558135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a86c4-2bc5-4fe8-8b71-89b56671a4e4 service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:42.558307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] PATH_INFO: `/v3/users/359c9fcda1074ed2b1ed75ce660cfcb9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:42.561615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359c9fcda1074ed2b1ed75ce660cfcb9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:42.566816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:42.577139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:42.577823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:42.578108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:42.578526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] PATH_INFO: `/v3/projects/04583416a486488fa29aa1cbfef3c29f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:42.580380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04583416a486488fa29aa1cbfef3c29f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:42.582522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:42.690094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359c9fcda1074ed2b1ed75ce660cfcb9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.701806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359c9fcda1074ed2b1ed75ce660cfcb9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.703852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359c9fcda1074ed2b1ed75ce660cfcb9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.719462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359c9fcda1074ed2b1ed75ce660cfcb9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.721696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-00ddd2f7-55eb-45fa-a228-532e97804641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359c9fcda1074ed2b1ed75ce660cfcb9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.729163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04583416a486488fa29aa1cbfef3c29f', 'request_id': 'req-f29ebf7d-2cd0-4901-ae3b-d96fda475578'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.749219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04583416a486488fa29aa1cbfef3c29f', 'request_id': 'req-f29ebf7d-2cd0-4901-ae3b-d96fda475578'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.761343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 761/1521] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:42 2022] DELETE /identity/v3/users/359c9fcda1074ed2b1ed75ce660cfcb9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:42.767161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04583416a486488fa29aa1cbfef3c29f', 'request_id': 'req-f29ebf7d-2cd0-4901-ae3b-d96fda475578'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.787653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:42.788182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:42.789977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:42.798132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] The token cache is being invalidate because project 04583416a486488fa29aa1cbfef3c29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:42.798450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.801162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:42.807076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 761/1522] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:42 2022] DELETE /identity/v3/projects/04583416a486488fa29aa1cbfef3c29f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:42.811180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:42.812978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.830668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:42.833669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.942712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 762/1523] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:42.957084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebf7d-2cd0-4901-ae3b-d96fda475578 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:42.965351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:42.966053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:42.966323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:42.966670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] PATH_INFO: `/v3/users/32fd9d64a07f4cef82669aed801e8e26` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:42.968560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fd9d64a07f4cef82669aed801e8e26)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:42.971276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:42.973973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:42.983716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:43.083511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:43.161723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fd9d64a07f4cef82669aed801e8e26'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.166662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fd9d64a07f4cef82669aed801e8e26'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.190389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fd9d64a07f4cef82669aed801e8e26'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.191888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fd9d64a07f4cef82669aed801e8e26'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.197617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb5c81-d8be-405b-876c-0bc93dbdb28c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:43.198698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:43.204816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:43.205863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:43.206151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:43.207258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:43.208393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fd9d64a07f4cef82669aed801e8e26'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.214535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:43.285098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 762/1524] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:42 2022] DELETE /identity/v3/users/32fd9d64a07f4cef82669aed801e8e26 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:43.295866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:43.312209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:43.343883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 763/1525] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:43.778989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:43.780540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:43.869406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16c63-b5e6-4a75-88ee-b4128e55e984 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:43.874388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:43.875106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:43.875458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:43.875915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] PATH_INFO: `/v3/projects/c7e457312f47494fa684820b23dd2d2c` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:43.877143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e457312f47494fa684820b23dd2d2c)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:43.879424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:43.943492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e457312f47494fa684820b23dd2d2c', 'request_id': 'req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.954654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e457312f47494fa684820b23dd2d2c', 'request_id': 'req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.963685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:43.965304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:43.974938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e457312f47494fa684820b23dd2d2c', 'request_id': 'req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.997542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] The token cache is being invalidate because project c7e457312f47494fa684820b23dd2d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:43.997934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:43.998664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.001811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 763/1526] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:43 2022] DELETE /identity/v3/projects/c7e457312f47494fa684820b23dd2d2c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:44.003121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.005120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.015515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a46b7-2d3b-4725-8372-4cda0eff54b9 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.095065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.095739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.096023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.096299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] PATH_INFO: `/v3/projects/7e8da831154c42d6813148a9d91cd909` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.097524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8da831154c42d6813148a9d91cd909)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.099901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.108203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099ef28-4e58-4d87-aa20-c0aed08a8a3d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.114134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.115056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.115397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.115736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] PATH_INFO: `/v3/projects/fc307c39ef294819aa68ffb8f24c3566` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.117891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc307c39ef294819aa68ffb8f24c3566)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.120029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.132392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:44.168732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8da831154c42d6813148a9d91cd909', 'request_id': 'req-129f2ae6-b580-47fd-9fd6-e451eab02ec1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.175761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8da831154c42d6813148a9d91cd909', 'request_id': 'req-129f2ae6-b580-47fd-9fd6-e451eab02ec1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.182824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc307c39ef294819aa68ffb8f24c3566', 'request_id': 'req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.184816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8da831154c42d6813148a9d91cd909', 'request_id': 'req-129f2ae6-b580-47fd-9fd6-e451eab02ec1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.190833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc307c39ef294819aa68ffb8f24c3566', 'request_id': 'req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.200477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc307c39ef294819aa68ffb8f24c3566', 'request_id': 'req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.201353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] The token cache is being invalidate because project 7e8da831154c42d6813148a9d91cd909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:44.201654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.202557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-129f2ae6-b580-47fd-9fd6-e451eab02ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.204732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 764/1527] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:43 2022] DELETE /identity/v3/projects/7e8da831154c42d6813148a9d91cd909 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:44.206521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.206809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.207088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.213544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] The token cache is being invalidate because project fc307c39ef294819aa68ffb8f24c3566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:44.213920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.214579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.216263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 764/1528] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:44 2022] DELETE /identity/v3/projects/fc307c39ef294819aa68ffb8f24c3566 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:44.219851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.221171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.232330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:44.233618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.293547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09e5b3-c904-43dd-b87b-5a1f1eefbc49 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.298347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.298541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:44.299116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.299488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.299842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] PATH_INFO: `/v3/projects/81daa5a3f45d44d59791cc425f2d2ef8` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.301089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81daa5a3f45d44d59791cc425f2d2ef8)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.303161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.309728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 765/1529] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:44.310677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.312505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.333764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9284-b301-43e4-8068-307ddcacd9db None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.342072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.342755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.343060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.343302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] PATH_INFO: `/v3/users/aad0cfaa037a4d6baa2cd43232461584` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.344452 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad0cfaa037a4d6baa2cd43232461584)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.346442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.366426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81daa5a3f45d44d59791cc425f2d2ef8', 'request_id': 'req-78814cf3-a1a5-4627-88a2-66922eee0344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.373764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81daa5a3f45d44d59791cc425f2d2ef8', 'request_id': 'req-78814cf3-a1a5-4627-88a2-66922eee0344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.383141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81daa5a3f45d44d59791cc425f2d2ef8', 'request_id': 'req-78814cf3-a1a5-4627-88a2-66922eee0344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.400591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] The token cache is being invalidate because project 81daa5a3f45d44d59791cc425f2d2ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:44.400947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.402237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.402894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad0cfaa037a4d6baa2cd43232461584'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.404035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 765/1530] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:44 2022] DELETE /identity/v3/projects/81daa5a3f45d44d59791cc425f2d2ef8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:44.406529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.408092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.416715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad0cfaa037a4d6baa2cd43232461584'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.417523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad0cfaa037a4d6baa2cd43232461584'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.431837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad0cfaa037a4d6baa2cd43232461584'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.432475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-55bf4901-6f63-4d55-919e-c2d87893a509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad0cfaa037a4d6baa2cd43232461584'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.463879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 766/1531] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:44 2022] DELETE /identity/v3/users/aad0cfaa037a4d6baa2cd43232461584 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:44.463879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb088fc-f530-489b-914a-1ab71486cc5d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.463879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb088fc-f530-489b-914a-1ab71486cc5d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.463879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb088fc-f530-489b-914a-1ab71486cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.470474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:44.500335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78814cf3-a1a5-4627-88a2-66922eee0344 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.518401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-acb088fc-f530-489b-914a-1ab71486cc5d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:44.519772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-acb088fc-f530-489b-914a-1ab71486cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.600779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.602527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.602527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.602787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] PATH_INFO: `/v3/users/8ec46658eea9422d9b36b0f93656ceb0` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.604186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec46658eea9422d9b36b0f93656ceb0)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.612576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.656966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 767/1532] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:44.656966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.656966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.657259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.684995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:44.691643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec46658eea9422d9b36b0f93656ceb0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.692137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec46658eea9422d9b36b0f93656ceb0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.698001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.707809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 768/1533] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:44.708797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.723405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea3c2-c347-408b-8ecc-3cee9f1e393f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.725355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec46658eea9422d9b36b0f93656ceb0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.726286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec46658eea9422d9b36b0f93656ceb0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.728813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.729502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.729881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.730220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.730936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:44.731361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.733156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c153b-fa72-4a04-ae3d-14c63fef407a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.739981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec46658eea9422d9b36b0f93656ceb0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:44.749141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 769/1534] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:44.749913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.750198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.750489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.771347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 766/1535] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:44 2022] DELETE /identity/v3/users/8ec46658eea9422d9b36b0f93656ceb0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:44.772643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.775212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.777880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:44.779198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.846896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:44.871263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:44.874019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 770/1536] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:44.875193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.876407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330852bd-9e07-4211-8f5a-ab048528bb25 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:44.883985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:44.884524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:44.885227 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:44.885351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:44.886776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:44.888633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:44.891473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:44.936338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 767/1537] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:44 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:44.936338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:44.947068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d314b-ff75-4f35-b7cc-b1f7b0aada83 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.037488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.038327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.038605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.039913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] PATH_INFO: `/v3/projects/0ce2f0455bbf4d47883b6c19ef48cb75` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.041348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce2f0455bbf4d47883b6c19ef48cb75)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.043414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.051966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83226007-a31d-4a34-8075-401bb28b6fc5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.058292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.059025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.059484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.059742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.060506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:45.060895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.062837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.076569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 768/1538] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:45.081182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.092689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba49210-c8eb-42d9-9123-fdf5d67d0f07 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.098721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce2f0455bbf4d47883b6c19ef48cb75', 'request_id': 'req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.107654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce2f0455bbf4d47883b6c19ef48cb75', 'request_id': 'req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.119181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce2f0455bbf4d47883b6c19ef48cb75', 'request_id': 'req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.141191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] The token cache is being invalidate because project 0ce2f0455bbf4d47883b6c19ef48cb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:45.141605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.142402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.144036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 771/1539] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:44 2022] DELETE /identity/v3/projects/0ce2f0455bbf4d47883b6c19ef48cb75 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:45.144892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.147119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.162116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371d285-b1f5-48f6-a7af-aac2b465118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.162741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371d285-b1f5-48f6-a7af-aac2b465118c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.163160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371d285-b1f5-48f6-a7af-aac2b465118c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.163332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371d285-b1f5-48f6-a7af-aac2b465118c admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.164032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371d285-b1f5-48f6-a7af-aac2b465118c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.167181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371d285-b1f5-48f6-a7af-aac2b465118c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.200795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 769/1540] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:45.200795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.200795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.200795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.221016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:45.222249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.228570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a5ad0-81fa-4e5d-abf4-56b9894a8fd9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.231056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 770/1541] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:45.231910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.233114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.236146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.236767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.237242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.237586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.238349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.240266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.245186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81fecf-f0a3-4957-a4ff-b822400085da None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.249840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.250456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.250729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.251001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] PATH_INFO: `/v3/projects/4f30763f9e714a3ba8da323ef820dbca` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.252095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f30763f9e714a3ba8da323ef820dbca)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.254025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.275608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 772/1542] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:45.275608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.275608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.285088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:45.307206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f30763f9e714a3ba8da323ef820dbca', 'request_id': 'req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.309443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:45.315336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f30763f9e714a3ba8da323ef820dbca', 'request_id': 'req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.324527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f30763f9e714a3ba8da323ef820dbca', 'request_id': 'req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.335107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] The token cache is being invalidate because project 4f30763f9e714a3ba8da323ef820dbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:45.335387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.336803 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f9c3dd9c-8a66-4bad-bab3-f8d24ca01f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:45.338123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 771/1543] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:45 2022] DELETE /identity/v3/projects/4f30763f9e714a3ba8da323ef820dbca => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:45.339289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13be37-1c45-4264-8585-d916b7a8adf2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.339577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13be37-1c45-4264-8585-d916b7a8adf2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.339833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13be37-1c45-4264-8585-d916b7a8adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.348562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dbc09-5102-40e6-9e09-65ada04d2e85 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.363380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-5a13be37-1c45-4264-8585-d916b7a8adf2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:45.363639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5a13be37-1c45-4264-8585-d916b7a8adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.410372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.411327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.411820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.412261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.413098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.414955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.431693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 773/1544] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:45.432829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.434741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.434992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 772/1545] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:45.436404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.437065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.437373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.448242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9e21-9c48-4631-8745-cda3f044ceab admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.452884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.453490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.453791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.454065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.454693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.456608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.459061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:45.460275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.469912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 773/1546] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:45.470836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.479361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.487642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 774/1547] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/users => generated 291 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:45.489390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.493131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094173c-9d0a-4150-945f-f47247fb4546 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.497994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a30c9e-4794-4c79-afa5-cf35cad0fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.498601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a30c9e-4794-4c79-afa5-cf35cad0fd7c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.498875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a30c9e-4794-4c79-afa5-cf35cad0fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.499160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a30c9e-4794-4c79-afa5-cf35cad0fd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.499780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a30c9e-4794-4c79-afa5-cf35cad0fd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.499952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5aa6-e2b9-4a8b-9256-037bc5de434e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.501366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a30c9e-4794-4c79-afa5-cf35cad0fd7c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.504514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.505105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.505381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.505652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.506330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:45.506629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.508294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.516733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 774/1548] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:45.516733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.516733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.516733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.521471 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 775/1549] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:45.522339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.534441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265c22-98db-477b-8d19-07cb41f11f71 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.540065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.540269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:45.540766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.541041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.541308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.541501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.541973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.543656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.550192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 775/1550] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:45.550896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.561389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 776/1551] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:45.561389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.561671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2e4ec-6d80-473a-9fbc-579830480c2e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.566713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.567304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.567583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.567848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] PATH_INFO: `/v3/projects/1d931c10d9d94211b536bda2832ce869/users/20bd1d7f08b9456bb05ba71a8b63d62f/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.572702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855f30-96a8-44d0-944f-26cf62c98056 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.578399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.579186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.579491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.579857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.580688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.582730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.584680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d931c10d9d94211b536bda2832ce869, user_id=20bd1d7f08b9456bb05ba71a8b63d62f, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.587507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.604862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 776/1552] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:45 2022] PUT /identity/v3/projects/1d931c10d9d94211b536bda2832ce869/users/20bd1d7f08b9456bb05ba71a8b63d62f/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:45.605732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.641601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 777/1553] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:45.642583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.700306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48910-58d7-4970-bc4c-aa47ab76ab03 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.713867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:45.732188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81052b3-4366-424b-920c-133f2292ccb1 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.737357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4851a6b-1e70-4013-8c4b-f7a7a484a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.738002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4851a6b-1e70-4013-8c4b-f7a7a484a3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.738321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4851a6b-1e70-4013-8c4b-f7a7a484a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.738542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4851a6b-1e70-4013-8c4b-f7a7a484a3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.739182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4851a6b-1e70-4013-8c4b-f7a7a484a3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.740775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4851a6b-1e70-4013-8c4b-f7a7a484a3ee admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.754728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 778/1554] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:45.756095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.756449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.756641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.761201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:45.784544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.785184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.785484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.785937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.786703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:45.787049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.789487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.795606 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] MFA Rules not processed for user `20bd1d7f08b9456bb05ba71a8b63d62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:45.796938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:45.805828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 777/1555] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:45.805828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.813978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86767578-4069-4f9c-ad6e-e489a213f1ac admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.818745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.819282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.819553 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.819817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.820659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.822816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.843988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 778/1556] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:45.844792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.855267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb3dc9-1a13-40cb-b0e0-165ac0cfa951 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.860620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.861546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.861853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.862178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] PATH_INFO: `/v3/projects/8c4a45d7e73b465cbeda38bd87c4a7cc/users/31fb71def1354b63a3c60d9bfba80509/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.866373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 779/1557] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:45.867800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.878129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb0893-3473-4b1e-b803-dc945888a8ad None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.879506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4a45d7e73b465cbeda38bd87c4a7cc, user_id=31fb71def1354b63a3c60d9bfba80509, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.882367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.882654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.883385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.883665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.883938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.884571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.886506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.895586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 779/1558] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:45 2022] PUT /identity/v3/projects/8c4a45d7e73b465cbeda38bd87c4a7cc/users/31fb71def1354b63a3c60d9bfba80509/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:45.896678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.915044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 780/1559] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:45.915859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:45.987902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2361-1ace-4a1a-b9e4-a2f6dfe38f26 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.993548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1d03-8f64-43ab-9166-270cca0d2bd2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:45.993690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.994638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:45.994918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:45.995291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:45.996009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:45.998407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:45.999287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15d84-7214-4473-80ea-e9ffed384146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:45.999957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15d84-7214-4473-80ea-e9ffed384146 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.000240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15d84-7214-4473-80ea-e9ffed384146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.000515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15d84-7214-4473-80ea-e9ffed384146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.001170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15d84-7214-4473-80ea-e9ffed384146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.002808 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15d84-7214-4473-80ea-e9ffed384146 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.017308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 780/1560] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.017308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.017308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.017308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.033462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 781/1561] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:45 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:46.034565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.050924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] MFA Rules not processed for user `31fb71def1354b63a3c60d9bfba80509`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:46.052740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:46.083835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:46.110853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182590-7981-46c3-b63d-420b78113a40 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.118473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.119513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.119513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.119886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.120722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.123392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.130123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 781/1562] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:46.134368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.146061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa30e3-cb53-444b-8236-e22fa3caae17 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.150200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 782/1563] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:46.151105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.151840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.152449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.152808 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.153063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.153707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.155341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.164117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380a34-ccd8-450c-82e6-c085f5cd27b8 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.169235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.169818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 782/1564] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.169991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.170176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.170449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.171168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.171919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.173414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.185507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bbea-6ce3-48cc-ae7e-d5fe0153a42d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.189775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.190467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.190730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.191012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.191651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.193607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.198456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:46.206489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 783/1565] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:46.206489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.218422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db3e06-1c81-4130-b3e9-541b00546128 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.224117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 783/1566] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:46.224565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.224754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.224844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.225032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.225306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.226103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.228129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.255348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 784/1567] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.255348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.265881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0490d35-8bd5-46f7-a16a-a8c132d018aa admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.292879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b83fa-5fe5-4afd-b5b7-4ef576d686b9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.297528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.298211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.298488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.298761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] PATH_INFO: `/v3/projects/52773d7df39c4501b397d53d539fbd54/users/f253fae9f7494a8eb2b2a04e4eed5422/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.314132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=52773d7df39c4501b397d53d539fbd54, user_id=f253fae9f7494a8eb2b2a04e4eed5422, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.317371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.324741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.325363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.325671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.325969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.326608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.328214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.331309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 784/1568] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:46 2022] PUT /identity/v3/projects/52773d7df39c4501b397d53d539fbd54/users/f253fae9f7494a8eb2b2a04e4eed5422/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:46.341315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 785/1569] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.341496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.341587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.350769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26d2d-16e1-46ac-b2fb-dea2639ae40f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.403817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48635a1-d853-4901-aad2-e0c549292ffd admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.408004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149261e-eb10-44bc-a3cf-6ec1ed15e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.408272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.408615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149261e-eb10-44bc-a3cf-6ec1ed15e35e admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.408872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.408969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149261e-eb10-44bc-a3cf-6ec1ed15e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.409159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149261e-eb10-44bc-a3cf-6ec1ed15e35e admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.409254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.409512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.409829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149261e-eb10-44bc-a3cf-6ec1ed15e35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.410163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.411625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149261e-eb10-44bc-a3cf-6ec1ed15e35e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.412052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.423177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 786/1570] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.424654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.424941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.425256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.437317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 785/1571] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:46.438494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.449315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c37e-5bc6-46cb-a036-27166ce2c865 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.453585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] MFA Rules not processed for user `f253fae9f7494a8eb2b2a04e4eed5422`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:46.454451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.454815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:46.455177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.455453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.455725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] PATH_INFO: `/v3/projects/20148fec7c03420a9d633abe5b9265d2/users/cad94eddf6f54ec69763a69fa3ead0ef/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.471535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20148fec7c03420a9d633abe5b9265d2, user_id=cad94eddf6f54ec69763a69fa3ead0ef, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.473778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:46.474323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.488003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 786/1572] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:46 2022] PUT /identity/v3/projects/20148fec7c03420a9d633abe5b9265d2/users/cad94eddf6f54ec69763a69fa3ead0ef/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:46.488866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.522806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:46.524281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 787/1573] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:46.525214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.536271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccb43b-6814-4504-b1ab-6fc13cef12ac None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.553395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27504-9bd9-42d9-bf89-0517e8869c04 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.559612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.560346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.560885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.561228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] PATH_INFO: `/v3/projects/d670ce85ba44496282a659eed410f335/users/26a9acea6e884298bdea0424ae5d2c37/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.579672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d670ce85ba44496282a659eed410f335, user_id=26a9acea6e884298bdea0424ae5d2c37, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.582618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.597943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 787/1574] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:46 2022] PUT /identity/v3/projects/d670ce85ba44496282a659eed410f335/users/26a9acea6e884298bdea0424ae5d2c37/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:46.602672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.603178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.603458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.603727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.604366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.606055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.609233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.618879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 788/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.619744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.631397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df871c1-6f5f-4aff-9b6d-4f2779474874 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.690335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426626f-a8e8-4da3-b34d-55a23e81344a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.697696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1d1b-4e10-40e5-85dd-74801169d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.698360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1d1b-4e10-40e5-85dd-74801169d084 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.699073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1d1b-4e10-40e5-85dd-74801169d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.699279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1d1b-4e10-40e5-85dd-74801169d084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.701004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a1d1b-4e10-40e5-85dd-74801169d084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.703377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a1d1b-4e10-40e5-85dd-74801169d084 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.721817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 788/1576] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:46.721817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.721817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.721817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.737642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.738408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.740742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.741181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.742062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.744514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.757838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] MFA Rules not processed for user `26a9acea6e884298bdea0424ae5d2c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:46.759673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:46.783084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 789/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:46.784059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.841277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:46.846163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 789/1578] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:46.847089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.859472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc08bfb-2512-4027-b29c-6d57d65b9525 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.868215 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.869416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.869416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.869650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] PATH_INFO: `/v3/projects/20148fec7c03420a9d633abe5b9265d2/users/cad94eddf6f54ec69763a69fa3ead0ef/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.871757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20148fec7c03420a9d633abe5b9265d2, user_id=cad94eddf6f54ec69763a69fa3ead0ef, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.872733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a0d3-7782-4897-a4a1-2af218a07315 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:46.874969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.878889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:46.880477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:46.881377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:46.881682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] PATH_INFO: `/v3/projects/949985514d7846e483968d4b704c97e7/users/cf93577e3b2e471995c27d4788452521/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:46.893784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 790/1579] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:46 2022] PUT /identity/v3/projects/20148fec7c03420a9d633abe5b9265d2/users/cad94eddf6f54ec69763a69fa3ead0ef/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:46.893784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.901619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=949985514d7846e483968d4b704c97e7, user_id=cf93577e3b2e471995c27d4788452521, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:46.904540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:46.925008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 790/1580] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:46 2022] PUT /identity/v3/projects/949985514d7846e483968d4b704c97e7/users/cf93577e3b2e471995c27d4788452521/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:46.925008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:46.953384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:47.006602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeb6ed-55ae-472c-b64e-ae48e4e0ab27 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.016094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774181b-5a54-4b77-9bca-bd5856e9bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.017431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774181b-5a54-4b77-9bca-bd5856e9bc61 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.017806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774181b-5a54-4b77-9bca-bd5856e9bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.018309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774181b-5a54-4b77-9bca-bd5856e9bc61 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.019117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774181b-5a54-4b77-9bca-bd5856e9bc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.020971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956cbb-3bf6-4d71-8519-95292d422ebb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.021522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774181b-5a54-4b77-9bca-bd5856e9bc61 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.028032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.028959 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.029461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.030054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.031247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.033172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.059837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 791/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:47.061046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.061633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.062028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.080860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 791/1582] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:46 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:47.082668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.106632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] MFA Rules not processed for user `cad94eddf6f54ec69763a69fa3ead0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:47.107767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:47.184060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7517ae-d74d-437e-92e5-bba085b96d09 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.189954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.190575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.191072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.191352 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.192039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.194520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.214361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 792/1583] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:47.215282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.217525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 792/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:47.218543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.232116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ab83-dbfa-43dd-af9d-9d6de36bf4cb None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.235562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed223-1445-402b-b1c9-adc8b8bf22aa admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.237256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.238222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.238566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.238819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.239755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.241898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.245058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.246040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.246220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.246494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.248097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.251402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.258188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 793/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:47.258188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.270745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646962c9-79c0-4f18-86ff-fc4707c47ec6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.276823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.278126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.278497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.279154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] PATH_INFO: `/v3/projects/949985514d7846e483968d4b704c97e7/users/cf93577e3b2e471995c27d4788452521/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.281580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949985514d7846e483968d4b704c97e7, user_id=cf93577e3b2e471995c27d4788452521, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.281762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 793/1586] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:47 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:47.285245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.286363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.290590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:47.301973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 794/1587] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:47 2022] PUT /identity/v3/projects/949985514d7846e483968d4b704c97e7/users/cf93577e3b2e471995c27d4788452521/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:47.312806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.334065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:47.372331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365dfe-bd09-431f-8b11-8f0fffed8fe2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.440349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.440985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.441402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.442160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.532254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.532254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.541759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 794/1588] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:47.543328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.600216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43ca44-284e-4cb2-aee3-f106ad8eb579 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.605598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484058-1146-4e1f-a82c-3af83208415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.606333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484058-1146-4e1f-a82c-3af83208415a admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.606746 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484058-1146-4e1f-a82c-3af83208415a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.607024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484058-1146-4e1f-a82c-3af83208415a admin admin] PATH_INFO: `/v3/projects/a492ccc1bcbf4982822f6eeb4ed5f39e/users/1bc50c39bedb433c94bf0d9520562400/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.624581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484058-1146-4e1f-a82c-3af83208415a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a492ccc1bcbf4982822f6eeb4ed5f39e, user_id=1bc50c39bedb433c94bf0d9520562400, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.627508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484058-1146-4e1f-a82c-3af83208415a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.646146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9f2c-9ec9-4d43-af01-8056e4339bed service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.646996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 795/1589] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:47 2022] PUT /identity/v3/projects/a492ccc1bcbf4982822f6eeb4ed5f39e/users/1bc50c39bedb433c94bf0d9520562400/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:47.649019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.649371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.649919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.659596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:47.693403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] MFA Rules not processed for user `cf93577e3b2e471995c27d4788452521`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:47.696448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:47.708472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:47.728208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.729236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.729525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.730281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.731491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.732822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.749936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 795/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:47.749936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.766178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932ec94-574a-422f-bec2-002236423306 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.780424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.781760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.782087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.782443 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.785449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.787865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.808270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 796/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:47.809539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.828110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a35a0a-ccde-491d-b318-8f1abf209eec admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.834050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.834667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.834946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.835220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.836456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.838128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.854727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 797/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:47.854727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.865525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d9e1a-da3e-4816-92c2-cf314524e51d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.866568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 796/1593] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:47.867853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.875831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.876520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.876852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.877134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] PATH_INFO: `/v3/projects/a492ccc1bcbf4982822f6eeb4ed5f39e/users/1bc50c39bedb433c94bf0d9520562400/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.879245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=a492ccc1bcbf4982822f6eeb4ed5f39e, user_id=1bc50c39bedb433c94bf0d9520562400, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.882139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.884600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7e59c-d323-4020-bb9b-a8e73b6dc2e9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:47.891670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa174f-48e6-483d-b8e1-9b54cbb64293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:47.892360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa174f-48e6-483d-b8e1-9b54cbb64293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.892633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa174f-48e6-483d-b8e1-9b54cbb64293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.892900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa174f-48e6-483d-b8e1-9b54cbb64293 admin admin] PATH_INFO: `/v3/projects/085dd72ef13246f986e2783b1f163b7e/users/de2a6594c5a9462fadc444af13fda5c9/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.907816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 798/1594] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:47 2022] PUT /identity/v3/projects/a492ccc1bcbf4982822f6eeb4ed5f39e/users/1bc50c39bedb433c94bf0d9520562400/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:47.908711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:47.910414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:47.922021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa174f-48e6-483d-b8e1-9b54cbb64293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085dd72ef13246f986e2783b1f163b7e, user_id=de2a6594c5a9462fadc444af13fda5c9, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:47.925923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa174f-48e6-483d-b8e1-9b54cbb64293 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:47.943130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 797/1595] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:47 2022] PUT /identity/v3/projects/085dd72ef13246f986e2783b1f163b7e/users/de2a6594c5a9462fadc444af13fda5c9/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:47.952945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529b51-6337-4bcb-90da-2d3a22ef724c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:47.952945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529b51-6337-4bcb-90da-2d3a22ef724c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:47.952945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529b51-6337-4bcb-90da-2d3a22ef724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:47.990815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-80529b51-6337-4bcb-90da-2d3a22ef724c None None] MFA Rules not processed for user `1bc50c39bedb433c94bf0d9520562400`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:47.992442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-80529b51-6337-4bcb-90da-2d3a22ef724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:47.998651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e430ff8-e707-461b-828e-bbb688468ece admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.067887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.068796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.069754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.070877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.087631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 798/1596] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:48.088987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.089275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.089546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.128751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] MFA Rules not processed for user `de2a6594c5a9462fadc444af13fda5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:48.130651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:48.144652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.146606 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.160049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 799/1597] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:48.161200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.171213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686657b7-fe6d-41d0-9766-602c5d9f29a1 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.176316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.177851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.178483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.178941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.191825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:48.193256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.195652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.203048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:48.209729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 800/1598] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:48.226075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 799/1599] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:48.233292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.334645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.347282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1424-fe16-4f9d-b33b-0a60156e3b56 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.350131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d906e2-d5c2-4024-970c-b3b7292338b5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.352562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.353312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.353841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.354224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.354909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.356587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.356830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.357593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.358063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.358476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] PATH_INFO: `/v3/users/f253fae9f7494a8eb2b2a04e4eed5422` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.360555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f253fae9f7494a8eb2b2a04e4eed5422)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.363214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.400490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 801/1600] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:48 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:48.404135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.449666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f253fae9f7494a8eb2b2a04e4eed5422'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:48.450466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f253fae9f7494a8eb2b2a04e4eed5422'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:48.463608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f253fae9f7494a8eb2b2a04e4eed5422'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:48.464583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f253fae9f7494a8eb2b2a04e4eed5422'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:48.474892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14c32b6-2ea8-464f-86ce-2907631fb17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f253fae9f7494a8eb2b2a04e4eed5422'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:48.517202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 800/1601] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:48 2022] DELETE /identity/v3/users/f253fae9f7494a8eb2b2a04e4eed5422 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:48.521886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.522450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.522925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.529356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c49fea-33f0-4276-8e48-623e98f9079f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.560426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:48.563367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:48.637685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.639460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.639460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.639460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.640092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.642476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.679650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 802/1602] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:48 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:48.681086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.683087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:48.701075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56c39-873d-43fa-8426-6a7d3e767e33 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.707750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.709228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.709714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.711666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.712609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.715626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.716751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 801/1603] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:48.733088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 803/1604] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:48.734920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.738374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:48.741419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.780128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4d6f-c323-4dca-b151-13e9eb162b4a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.796786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:48.799215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:48.800032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:48.800521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] PATH_INFO: `/v3/projects/782db00914684bfab9d6296a93c86c73/users/14bf698bb5ef40d29075a26f69fc3f28/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:48.826297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:48.848919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782db00914684bfab9d6296a93c86c73, user_id=14bf698bb5ef40d29075a26f69fc3f28, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:48.859539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:48.897021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685d5c-157b-4dc9-846f-a3af2f2d2ea5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:48.902277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 804/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:48 2022] PUT /identity/v3/projects/782db00914684bfab9d6296a93c86c73/users/14bf698bb5ef40d29075a26f69fc3f28/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:48.906270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:48.909130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:49.058716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.059341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.059614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.059880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.083368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.084777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19436-469d-44c2-ace5-65333c282962 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.084920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.096404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 802/1606] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:49.101815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.103451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.103727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.104009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.104679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.112137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.146338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:49.148338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.149949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 805/1607] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:49.155402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:49.183503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7714c-65be-485b-b2a3-89b7871dc045 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.207647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32427a9-eda3-4432-85c1-9dc8e82fa6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.208554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32427a9-eda3-4432-85c1-9dc8e82fa6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.208695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38445a-d948-44ce-a52d-0ed9f77ee5a3 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.208865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32427a9-eda3-4432-85c1-9dc8e82fa6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.209111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32427a9-eda3-4432-85c1-9dc8e82fa6b6 admin admin] PATH_INFO: `/v3/projects/782db00914684bfab9d6296a93c86c73/users/14bf698bb5ef40d29075a26f69fc3f28/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.213426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32427a9-eda3-4432-85c1-9dc8e82fa6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782db00914684bfab9d6296a93c86c73, user_id=14bf698bb5ef40d29075a26f69fc3f28, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.216969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32427a9-eda3-4432-85c1-9dc8e82fa6b6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.231704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.232561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.232838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.233118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] PATH_INFO: `/v3/users/31fb71def1354b63a3c60d9bfba80509` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.234591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fb71def1354b63a3c60d9bfba80509)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.236732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.249669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 806/1608] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:49 2022] PUT /identity/v3/projects/782db00914684bfab9d6296a93c86c73/users/14bf698bb5ef40d29075a26f69fc3f28/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:49.264330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451c726-d55c-4d36-ad09-6dda4df5efb8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.264812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451c726-d55c-4d36-ad09-6dda4df5efb8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.265181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451c726-d55c-4d36-ad09-6dda4df5efb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.344334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9451c726-d55c-4d36-ad09-6dda4df5efb8 None None] MFA Rules not processed for user `14bf698bb5ef40d29075a26f69fc3f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:49.354989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9451c726-d55c-4d36-ad09-6dda4df5efb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.384342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fb71def1354b63a3c60d9bfba80509'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:49.385486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fb71def1354b63a3c60d9bfba80509'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:49.403021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fb71def1354b63a3c60d9bfba80509'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:49.403990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fb71def1354b63a3c60d9bfba80509'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:49.421407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fb71def1354b63a3c60d9bfba80509'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:49.452089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 803/1609] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:49 2022] DELETE /identity/v3/users/31fb71def1354b63a3c60d9bfba80509 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:49.452089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:49.454342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.489954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 807/1610] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:02:49.491425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.491939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.492939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.520395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:49.522981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.606628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:49.619004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318692ea-65b9-4fa3-a219-7f78a6d746f3 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.622673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.623480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.623764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.624036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.633476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.638633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 808/1611] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:49.639814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:49.644541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.667790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494a77b-702f-4c87-a6eb-514be83aa8f9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.672864 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.673775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.674270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.674714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.688921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:49.736431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.738338 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.752660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 804/1612] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:49.754507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:49.756126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:49.760474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.762013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.783429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 809/1613] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:49.843370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937f302-4538-46b0-87e1-c93ea47c5811 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.848722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.849598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.850854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.851473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.857134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:49.863409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:49.866400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:49.870281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5ec84-4b67-4d3d-b3f7-0ae552721879 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:49.879840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 805/1614] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:49.890616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:49.891943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:49.892893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:49.893596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:49.896273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:50.018898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:50.020997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:50.047086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 810/1615] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:50.048077 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:50.049972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:50.076999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e647-915c-40e1-8d15-0073744935dd service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:50.088322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:50.088981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:50.089262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:50.089537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] PATH_INFO: `/v3/projects/52773d7df39c4501b397d53d539fbd54` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:50.092889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=52773d7df39c4501b397d53d539fbd54)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:50.095038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:50.182208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52773d7df39c4501b397d53d539fbd54', 'request_id': 'req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.190162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52773d7df39c4501b397d53d539fbd54', 'request_id': 'req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.204600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52773d7df39c4501b397d53d539fbd54', 'request_id': 'req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.230542 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] The token cache is being invalidate because project 52773d7df39c4501b397d53d539fbd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:50.230822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.231549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.233590 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 806/1616] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:50 2022] DELETE /identity/v3/projects/52773d7df39c4501b397d53d539fbd54 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:50.238239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:50.254799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429a1de-edaa-4477-a271-73514be4b9c6 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:50.339224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:50.340735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:50.345703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:50.346510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:50.346806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:50.347064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] PATH_INFO: `/v3/users/1bc50c39bedb433c94bf0d9520562400` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:50.348191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc50c39bedb433c94bf0d9520562400)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:50.350174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:50.361139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68bcb2-30e3-47c9-a81e-5944333bd5bc admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:50.367222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:50.367948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:50.368237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:50.368516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] PATH_INFO: `/v3/projects/8c4a45d7e73b465cbeda38bd87c4a7cc` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:50.370111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4a45d7e73b465cbeda38bd87c4a7cc)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:50.372370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:50.432251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:50.445603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4a45d7e73b465cbeda38bd87c4a7cc', 'request_id': 'req-7719aac4-be02-4a86-8bba-6c18c4b3ad23'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.445603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:50.453771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4a45d7e73b465cbeda38bd87c4a7cc', 'request_id': 'req-7719aac4-be02-4a86-8bba-6c18c4b3ad23'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.466225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4a45d7e73b465cbeda38bd87c4a7cc', 'request_id': 'req-7719aac4-be02-4a86-8bba-6c18c4b3ad23'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.474244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc50c39bedb433c94bf0d9520562400'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.481175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] The token cache is being invalidate because project 8c4a45d7e73b465cbeda38bd87c4a7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:50.481175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.482013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.483257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc50c39bedb433c94bf0d9520562400'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.486788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc50c39bedb433c94bf0d9520562400'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.487014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 807/1617] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:50 2022] DELETE /identity/v3/projects/8c4a45d7e73b465cbeda38bd87c4a7cc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:50.487732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:50.489535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:50.494854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc50c39bedb433c94bf0d9520562400'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.495795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc50c39bedb433c94bf0d9520562400'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.528022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 811/1618] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:50 2022] DELETE /identity/v3/users/1bc50c39bedb433c94bf0d9520562400 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:50.564536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719aac4-be02-4a86-8bba-6c18c4b3ad23 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:50.656166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:50.656910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:50.658030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:50.658622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] PATH_INFO: `/v3/users/cf93577e3b2e471995c27d4788452521` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:50.662494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf93577e3b2e471995c27d4788452521)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:50.666749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:50.794722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf93577e3b2e471995c27d4788452521'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.796487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf93577e3b2e471995c27d4788452521'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.809115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf93577e3b2e471995c27d4788452521'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.812112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf93577e3b2e471995c27d4788452521'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.830838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e36e45d2-a37e-4d82-8068-83b6638417e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf93577e3b2e471995c27d4788452521'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:50.883327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 808/1619] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:50 2022] DELETE /identity/v3/users/cf93577e3b2e471995c27d4788452521 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:50.951105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:50.953362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:50.987946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c5d96-190c-45b7-a079-fda3497c2f03 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.075298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.077112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.078057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.078420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] PATH_INFO: `/v3/projects/a492ccc1bcbf4982822f6eeb4ed5f39e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.081755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a492ccc1bcbf4982822f6eeb4ed5f39e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.086749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.212752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a492ccc1bcbf4982822f6eeb4ed5f39e', 'request_id': 'req-46ade8c8-e333-473d-8f3f-59bae1a55ae5'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.227636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a492ccc1bcbf4982822f6eeb4ed5f39e', 'request_id': 'req-46ade8c8-e333-473d-8f3f-59bae1a55ae5'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.247769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a492ccc1bcbf4982822f6eeb4ed5f39e', 'request_id': 'req-46ade8c8-e333-473d-8f3f-59bae1a55ae5'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.267454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] The token cache is being invalidate because project a492ccc1bcbf4982822f6eeb4ed5f39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:51.268099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.268396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.276681 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 812/1620] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:50 2022] DELETE /identity/v3/projects/a492ccc1bcbf4982822f6eeb4ed5f39e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:51.279128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f281c4-d18d-475a-80e7-27ebe19915c2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.279505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f281c4-d18d-475a-80e7-27ebe19915c2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.280760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f281c4-d18d-475a-80e7-27ebe19915c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.319814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:51.350707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-07f281c4-d18d-475a-80e7-27ebe19915c2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:51.352871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-07f281c4-d18d-475a-80e7-27ebe19915c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:51.366508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.368848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:51.432540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:51.444001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 809/1621] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:51.446492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.447107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.447253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.469977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade8c8-e333-473d-8f3f-59bae1a55ae5 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.475105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:51.477034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:51.480811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.481597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.481908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.482190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] PATH_INFO: `/v3/projects/949985514d7846e483968d4b704c97e7` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.483881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949985514d7846e483968d4b704c97e7)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.486895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.490236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 810/1622] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:51.491157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.502372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3696e7d-702d-4184-9d9a-19280b6e594b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.509213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.509959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.510740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.510740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.511599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:51.511993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.514170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.531711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 811/1623] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:51.532741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.544948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250913e5-63e2-4aa3-aef0-19027c9ab53b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.555173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.555983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.558597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.559014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.559830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.564819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.620643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 812/1624] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:51.626891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949985514d7846e483968d4b704c97e7', 'request_id': 'req-ab83a001-9d27-4240-9330-9a820b2c6c92'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.627104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.643114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949985514d7846e483968d4b704c97e7', 'request_id': 'req-ab83a001-9d27-4240-9330-9a820b2c6c92'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.665517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949985514d7846e483968d4b704c97e7', 'request_id': 'req-ab83a001-9d27-4240-9330-9a820b2c6c92'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.684332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] The token cache is being invalidate because project 949985514d7846e483968d4b704c97e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:51.684869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.686308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ab83a001-9d27-4240-9330-9a820b2c6c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:51.690722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 813/1625] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:51 2022] DELETE /identity/v3/projects/949985514d7846e483968d4b704c97e7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:51.696493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7c550-ec36-47cb-8dee-5e1e202e0d2a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.697112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7c550-ec36-47cb-8dee-5e1e202e0d2a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.697601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7c550-ec36-47cb-8dee-5e1e202e0d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.747462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-31c7c550-ec36-47cb-8dee-5e1e202e0d2a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:51.748823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-31c7c550-ec36-47cb-8dee-5e1e202e0d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:51.751257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3728605-b842-4e6c-83ef-c41b8142db9d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.760939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.763422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.763921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.765065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.766181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.768859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.783005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 814/1626] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:02:51.786200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.786674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.787112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.801028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 813/1627] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:51.804965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.817596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:51.856433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:51.857648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:51.858368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357de4-7dfa-4f0e-9133-dd5401ae9f1e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.862918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.863641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.863923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.864195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.864920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.866480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.869285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 815/1628] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:51.875308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.884497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ecb61-80f2-4b79-aad2-52d0a6ec502a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.885973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 814/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:51.889097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.898542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.899169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.899521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.899820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.900513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:51.900814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.902699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.907642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fcc51-79c0-4ffd-aef2-d19a4c34099a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.914176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.914800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.915106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.915378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.916048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.917716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.925807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 816/1630] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:02:51.926564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.933845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 815/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:51.938078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:51.941020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db861981-e7cd-4078-a175-196e43c16998 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.946635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.947591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.947792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.948071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.948716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.950660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:51.964142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3bed1-c038-4d1f-bb97-9c5f6dda0428 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:51.969419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd253c-3dd7-455e-a0b4-886fdbbc4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:51.970138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd253c-3dd7-455e-a0b4-886fdbbc4283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:51.970413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd253c-3dd7-455e-a0b4-886fdbbc4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:51.970679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd253c-3dd7-455e-a0b4-886fdbbc4283 admin admin] PATH_INFO: `/v3/projects/028f16a1e4964e469ce7caaf59f128dc/users/3ff247c861744d329f5d889c7dc175dd/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:51.988516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd253c-3dd7-455e-a0b4-886fdbbc4283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028f16a1e4964e469ce7caaf59f128dc, user_id=3ff247c861744d329f5d889c7dc175dd, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:51.991463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd253c-3dd7-455e-a0b4-886fdbbc4283 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.002679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 817/1632] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:51 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:52.006445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.018423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 816/1633] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:51 2022] PUT /identity/v3/projects/028f16a1e4964e469ce7caaf59f128dc/users/3ff247c861744d329f5d889c7dc175dd/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:52.031518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.031777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.032068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.058087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:52.070378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] MFA Rules not processed for user `3ff247c861744d329f5d889c7dc175dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:52.075686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:52.119562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58eb1e-3a53-4ba1-b1a7-3997ca80e63a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.148419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:52.189559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.190334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.190687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.191045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.192469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.194722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.196821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 817/1634] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:52.201253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.213214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293becbf-2b4b-4cda-ada6-6689bf768d63 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.218939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.220165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.220621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.221058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.222096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.224023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.226460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 818/1635] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:52 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:02:52.234399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.252198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9752-c017-4c95-9bc3-7e936d8c6ea5 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.259249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.260123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.260408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.260688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.261342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.263332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.272716 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 818/1636] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:52 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:02:52.274437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 819/1637] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:02:52.277172 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.279998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.291314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e717e3-6a72-4360-9f73-75ba881205fb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.396843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.396843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.396843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.396843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.397560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.400049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.402244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aeccf-37dd-44bb-98bf-b1ef75a3a005 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.410682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 820/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:52.414937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.422489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.423463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.423573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.423847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.424706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.427560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.433395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54954-104d-404f-9ffd-c04ecc80b141 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.439682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74625237-c388-4cbc-ad3e-1efb085bfa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.440293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625237-c388-4cbc-ad3e-1efb085bfa17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.440599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625237-c388-4cbc-ad3e-1efb085bfa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.440878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625237-c388-4cbc-ad3e-1efb085bfa17 admin admin] PATH_INFO: `/v3/projects/5fdd0b6767a44db78c52d0d4223667ae/users/ea1d6596882a4ec6b0d6ae6fb1ad397e/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.455485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 819/1639] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:52 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:52.460458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.464035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74625237-c388-4cbc-ad3e-1efb085bfa17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fdd0b6767a44db78c52d0d4223667ae, user_id=ea1d6596882a4ec6b0d6ae6fb1ad397e, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.467188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74625237-c388-4cbc-ad3e-1efb085bfa17 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.473722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8192a-6230-4958-bf07-ecddcfefd88f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.483424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.483940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.484401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.484788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.485695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.487627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.488219 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 821/1640] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:52 2022] PUT /identity/v3/projects/5fdd0b6767a44db78c52d0d4223667ae/users/ea1d6596882a4ec6b0d6ae6fb1ad397e/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:52.494168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.494461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.495154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.504394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 820/1641] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:52.506855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.521088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b70eb1-f622-4168-8a6d-ee5379ba0a2c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.526695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:52.529132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:52.608924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:52.619328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.620084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.620430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.620796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] PATH_INFO: `/v3/projects/325a404f7953429383e8a039ea54e711/users/272b68e5b7ef4efaaaa9658e2ddad775/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.634005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 822/1642] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:52.638179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325a404f7953429383e8a039ea54e711, user_id=272b68e5b7ef4efaaaa9658e2ddad775, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.640844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.644438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.646318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:52.654576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 821/1643] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:52 2022] PUT /identity/v3/projects/325a404f7953429383e8a039ea54e711/users/272b68e5b7ef4efaaaa9658e2ddad775/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:52.658503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.666628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:52.707203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e404-c0d5-4b16-87d5-6fe03e8cde52 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.721774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2551-9ec8-4299-a1ee-cce251272f27 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.726414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.727013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.727363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.727639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.728276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.729897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.739821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 822/1644] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:02:52.744425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.754137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c288fe-a049-46f6-95d4-66245622c753 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:52.759903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941682d-268f-47ac-aa4c-1c4d916db368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.760544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941682d-268f-47ac-aa4c-1c4d916db368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.760857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941682d-268f-47ac-aa4c-1c4d916db368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.761125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941682d-268f-47ac-aa4c-1c4d916db368 admin admin] PATH_INFO: `/v3/projects/325a404f7953429383e8a039ea54e711/users/272b68e5b7ef4efaaaa9658e2ddad775/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.761796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:52.762725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.762942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.763241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.763368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941682d-268f-47ac-aa4c-1c4d916db368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325a404f7953429383e8a039ea54e711, user_id=272b68e5b7ef4efaaaa9658e2ddad775, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.766053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941682d-268f-47ac-aa4c-1c4d916db368 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.772501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:52.773984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:52.776529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 823/1645] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:52 2022] PUT /identity/v3/projects/325a404f7953429383e8a039ea54e711/users/272b68e5b7ef4efaaaa9658e2ddad775/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:52.783643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 823/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:02:52.787681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593fa7-65b7-4542-9b28-f84cc9a43571 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:52.787968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593fa7-65b7-4542-9b28-f84cc9a43571 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:52.788257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593fa7-65b7-4542-9b28-f84cc9a43571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:52.819239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f1593fa7-65b7-4542-9b28-f84cc9a43571 None None] MFA Rules not processed for user `272b68e5b7ef4efaaaa9658e2ddad775`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:52.821052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f1593fa7-65b7-4542-9b28-f84cc9a43571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:52.922014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 824/1647] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:52.937030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:52.939058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:53.055021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c1b4-f3d1-4d90-9ede-f4e9a986182b service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:53.168526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97728d-ee37-48db-bad9-c67466da60a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:53.169172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97728d-ee37-48db-bad9-c67466da60a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.169456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97728d-ee37-48db-bad9-c67466da60a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.169732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97728d-ee37-48db-bad9-c67466da60a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:53.181321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97728d-ee37-48db-bad9-c67466da60a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:53.184578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97728d-ee37-48db-bad9-c67466da60a9 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:53.211994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 824/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:53.271965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05074e8e-32ab-4bca-8351-5e6e966693e6 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.272332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05074e8e-32ab-4bca-8351-5e6e966693e6 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.272524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05074e8e-32ab-4bca-8351-5e6e966693e6 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:53.274555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 825/1649] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:02:53.308047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.308622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.308622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:53.346835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:53.349397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:53.426961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:53.504097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 825/1650] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:02:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:53.540813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05074e8e-32ab-4bca-8351-5e6e966693e6 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:53.545178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-05074e8e-32ab-4bca-8351-5e6e966693e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:53.564852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:53.567276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:53.600689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05074e8e-32ab-4bca-8351-5e6e966693e6 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:53.624261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:53.625185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.625494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.626816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:53.666016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:53.671299 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:53.676682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55843a-a75d-429a-88c2-3e3daacce8b7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:53.684170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:53.685554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.686200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.686699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] PATH_INFO: `/v3/users/26a9acea6e884298bdea0424ae5d2c37` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:53.689990 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a9acea6e884298bdea0424ae5d2c37)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:53.692747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:53.724072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 826/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:53.855721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a9acea6e884298bdea0424ae5d2c37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:53.872360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a9acea6e884298bdea0424ae5d2c37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:53.873565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a9acea6e884298bdea0424ae5d2c37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:53.892301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:53.924206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69292c62-84dd-4a3e-81d2-fd42fffa9852 service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:53.934492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a9acea6e884298bdea0424ae5d2c37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:53.936795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a9acea6e884298bdea0424ae5d2c37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:53.943294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272b68e5b7ef4efaaaa9658e2ddad775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '325a404f7953429383e8a039ea54e711', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:53.943918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.944201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.944522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:53.945998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:53.946307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:53.947917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627984c5-92fa-4675-9c57-5fc15d1d3b10 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:53.974436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 827/1652] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:53.975750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6fc0-355c-49d6-bd19-1d3a6489174c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:53.976550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6fc0-355c-49d6-bd19-1d3a6489174c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:53.976831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6fc0-355c-49d6-bd19-1d3a6489174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.004698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 826/1653] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:53 2022] DELETE /identity/v3/users/26a9acea6e884298bdea0424ae5d2c37 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:54.006355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.009730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.019421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-12de6fc0-355c-49d6-bd19-1d3a6489174c None None] MFA Rules not processed for user `ea1d6596882a4ec6b0d6ae6fb1ad397e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:54.021464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-12de6fc0-355c-49d6-bd19-1d3a6489174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.034192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:54.111375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 828/1654] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:54.111375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.111375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.111375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.119147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:54.132723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:54.134993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.157450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f180436-7802-435a-b299-8a8c370d9961 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.170880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272b68e5b7ef4efaaaa9658e2ddad775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '325a404f7953429383e8a039ea54e711', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.171527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.171805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.172076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.175727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.180350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.287631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 827/1655] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:54 2022] POST /identity/v3/projects => generated 354 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:54.295141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.303213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.305859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 829/1656] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:54.310786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.343298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6894ee-5a7d-4f3e-8374-c93c85d0e4e5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.504056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8999628-8d2b-4d55-b034-99c4478a7317 tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.523605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.528408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.528951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.531016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.532126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.542391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.553402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272b68e5b7ef4efaaaa9658e2ddad775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '325a404f7953429383e8a039ea54e711', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.554171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.554465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.554704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.555396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:54.555703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.557310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.576743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 830/1657] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:54.577464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.594391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.599105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 828/1658] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:54 2022] POST /identity/v3/projects => generated 373 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:54.600315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.604758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.627838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eb448-381f-4809-a8d0-9a06f61aca6a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.687844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e14e-e7a9-4360-8e44-13e813439d8b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.690357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:54.696024 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.696931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.697393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.698619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.717482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.718189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.718505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.718939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] PATH_INFO: `/v3/users/20bd1d7f08b9456bb05ba71a8b63d62f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.720419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bd1d7f08b9456bb05ba71a8b63d62f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.722344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.775378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bd1d7f08b9456bb05ba71a8b63d62f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:54.776014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bd1d7f08b9456bb05ba71a8b63d62f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:54.782869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bd1d7f08b9456bb05ba71a8b63d62f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:54.783384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.783579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bd1d7f08b9456bb05ba71a8b63d62f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:54.784870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.791985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bd1d7f08b9456bb05ba71a8b63d62f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:54.795753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 829/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:54.796540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.807540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752509ba-6c92-45da-89ef-1011b01444f5 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.812516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428de76-919a-4dfb-b728-200098600c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.813299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428de76-919a-4dfb-b728-200098600c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.813720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428de76-919a-4dfb-b728-200098600c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.814211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428de76-919a-4dfb-b728-200098600c62 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.814850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428de76-919a-4dfb-b728-200098600c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.814983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 831/1660] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:54 2022] DELETE /identity/v3/users/20bd1d7f08b9456bb05ba71a8b63d62f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:54.816123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.816734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428de76-919a-4dfb-b728-200098600c62 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.818741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.826307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:54.848829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 830/1661] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:54 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:54.850780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.851652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.852000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.878240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:54.879806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.911325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e8ff9-051a-481c-80d5-dbde3d920d1b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:54.918053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272b68e5b7ef4efaaaa9658e2ddad775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '325a404f7953429383e8a039ea54e711', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:54.918802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:54.919178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:54.919554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] PATH_INFO: `/v3/projects/c9c8d01b3e3f47ad85434f8711614d49` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:54.922647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c9c8d01b3e3f47ad85434f8711614d49)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:54.925170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:54.982626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 831/1662] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:54.983737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:54.984997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:54.998513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89121b-375f-4447-b2b3-cb7f9e2ca0de None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.025761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c8d01b3e3f47ad85434f8711614d49', 'request_id': 'req-0cbf1182-d65a-4631-976d-1d228d8c558a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.038033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c8d01b3e3f47ad85434f8711614d49', 'request_id': 'req-0cbf1182-d65a-4631-976d-1d228d8c558a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.059886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c8d01b3e3f47ad85434f8711614d49', 'request_id': 'req-0cbf1182-d65a-4631-976d-1d228d8c558a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.068251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:55.080665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] The token cache is being invalidate because project c9c8d01b3e3f47ad85434f8711614d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:55.081205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.082061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.082856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.083896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.084180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.084455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.085105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.087650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.090960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 832/1663] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:54 2022] DELETE /identity/v3/projects/c9c8d01b3e3f47ad85434f8711614d49 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:55.091928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.093480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.112292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 832/1664] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:55.118485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.121126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.154093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb515e6-105b-44b0-b10f-ef88fe3a79fc admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.179055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.181884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.182312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.182726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] PATH_INFO: `/v3/projects/098a6c6076f64a2fb5732b87db44122d/users/bac4f7a705d34783a26ac0c09ed3ca9a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.221935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098a6c6076f64a2fb5732b87db44122d, user_id=bac4f7a705d34783a26ac0c09ed3ca9a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.234564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.241108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1182-d65a-4631-976d-1d228d8c558a tempest-VolumeQuotaClassesTest-105968514 tempest-VolumeQuotaClassesTest-105968514-project-admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.246379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.247217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.247650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.248079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.250491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.265772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.266901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.273487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 833/1665] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:55 2022] PUT /identity/v3/projects/098a6c6076f64a2fb5732b87db44122d/users/bac4f7a705d34783a26ac0c09ed3ca9a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:55.274675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.276753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.280743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 833/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:55.281727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.293489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdf92f-15cb-4af9-a7a7-59e7cfe307ad service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.374288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.374990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.375191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.375375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7dce-04d8-4215-a11f-e13381ba8f69 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.375483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.376091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.377715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.380732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.381558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.381857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.382595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] PATH_INFO: `/v3/projects/d670ce85ba44496282a659eed410f335` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.383971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d670ce85ba44496282a659eed410f335)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.386178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.391994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 834/1667] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:55.392146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:55.392239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.395099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.408518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29497-b815-40ff-b209-8f52dd7a0056 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.415173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.415173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.415173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.415173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] PATH_INFO: `/v3/users/3ff247c861744d329f5d889c7dc175dd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.416880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff247c861744d329f5d889c7dc175dd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.419880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.477880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd670ce85ba44496282a659eed410f335', 'request_id': 'req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.484937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd670ce85ba44496282a659eed410f335', 'request_id': 'req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.497147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd670ce85ba44496282a659eed410f335', 'request_id': 'req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.502510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff247c861744d329f5d889c7dc175dd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.503896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff247c861744d329f5d889c7dc175dd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.513961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] The token cache is being invalidate because project d670ce85ba44496282a659eed410f335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:55.514795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.516239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.518824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 834/1668] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:55 2022] DELETE /identity/v3/projects/d670ce85ba44496282a659eed410f335 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:55.519792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.521025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.536447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff247c861744d329f5d889c7dc175dd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.539101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff247c861744d329f5d889c7dc175dd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.556558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff247c861744d329f5d889c7dc175dd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.581637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 835/1669] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:55 2022] DELETE /identity/v3/users/3ff247c861744d329f5d889c7dc175dd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:55.582946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.585452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.594810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:55.606652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfcddb-9dea-44d7-8355-c7c50dffbf05 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.698692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adfc93-204c-41ff-a00f-2101c6b278ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.699545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adfc93-204c-41ff-a00f-2101c6b278ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.701315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859e8e-2014-489d-9401-27262e3531d8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.701877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adfc93-204c-41ff-a00f-2101c6b278ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.702438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adfc93-204c-41ff-a00f-2101c6b278ee admin admin] PATH_INFO: `/v3/projects/098a6c6076f64a2fb5732b87db44122d/users/bac4f7a705d34783a26ac0c09ed3ca9a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.704759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adfc93-204c-41ff-a00f-2101c6b278ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=098a6c6076f64a2fb5732b87db44122d, user_id=bac4f7a705d34783a26ac0c09ed3ca9a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.707904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adfc93-204c-41ff-a00f-2101c6b278ee admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.708283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.709485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.709911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.711667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] PATH_INFO: `/v3/users/de2a6594c5a9462fadc444af13fda5c9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.713857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2a6594c5a9462fadc444af13fda5c9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.716098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:55.724461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 835/1670] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:55 2022] PUT /identity/v3/projects/098a6c6076f64a2fb5732b87db44122d/users/bac4f7a705d34783a26ac0c09ed3ca9a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:55.728145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.728490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.730040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.778839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:55.780546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.805370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2a6594c5a9462fadc444af13fda5c9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.806289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2a6594c5a9462fadc444af13fda5c9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.815997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2a6594c5a9462fadc444af13fda5c9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.816857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2a6594c5a9462fadc444af13fda5c9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.832607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2a6594c5a9462fadc444af13fda5c9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:55.843513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:55.854550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 836/1671] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:55 2022] DELETE /identity/v3/users/de2a6594c5a9462fadc444af13fda5c9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:55.855591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.857222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.913130 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 836/1672] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:55.928988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:55.931650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:55.959971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d995d5-348d-4dea-a6d7-697ac74ff59f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:55.967569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:55.968234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:55.968586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:55.969368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] PATH_INFO: `/v3/projects/1d931c10d9d94211b536bda2832ce869` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:55.970826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d931c10d9d94211b536bda2832ce869)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:55.975572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:56.047621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:56.085330 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d931c10d9d94211b536bda2832ce869', 'request_id': 'req-d5d0b406-99a5-46a9-80ff-27920ffde03d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.086821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9235-e241-45a8-a833-51d358caf386 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:56.098781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d931c10d9d94211b536bda2832ce869', 'request_id': 'req-d5d0b406-99a5-46a9-80ff-27920ffde03d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.128381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d931c10d9d94211b536bda2832ce869', 'request_id': 'req-d5d0b406-99a5-46a9-80ff-27920ffde03d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.147983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] The token cache is being invalidate because project 1d931c10d9d94211b536bda2832ce869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:56.148484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.150730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.156065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 837/1673] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:55 2022] DELETE /identity/v3/projects/1d931c10d9d94211b536bda2832ce869 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:56.159239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:56.163052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:56.184724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:56.186752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:56.188271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:56.188820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:56.196090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:56.359962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b406-99a5-46a9-80ff-27920ffde03d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:56.364185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:56.364834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:56.365114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:56.365394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] PATH_INFO: `/v3/users/cad94eddf6f54ec69763a69fa3ead0ef` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:56.367168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad94eddf6f54ec69763a69fa3ead0ef)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:56.369148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:56.378854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:56.380458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:56.392337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 837/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:56.393337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:56.394861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:56.410125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852556d-e229-4755-a675-fed839e216ff service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:56.417186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:56.418142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:56.418553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:56.418983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] PATH_INFO: `/v3/projects/085dd72ef13246f986e2783b1f163b7e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:56.420413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085dd72ef13246f986e2783b1f163b7e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:56.422645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:56.443297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad94eddf6f54ec69763a69fa3ead0ef'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.444445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad94eddf6f54ec69763a69fa3ead0ef'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.454522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad94eddf6f54ec69763a69fa3ead0ef'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.455363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad94eddf6f54ec69763a69fa3ead0ef'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.469345 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad94eddf6f54ec69763a69fa3ead0ef'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.487054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:56.505278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 838/1675] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:56 2022] DELETE /identity/v3/users/cad94eddf6f54ec69763a69fa3ead0ef => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:56.515595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085dd72ef13246f986e2783b1f163b7e', 'request_id': 'req-afad9fa0-f401-4f6a-9c39-61979ec12bd4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.524262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085dd72ef13246f986e2783b1f163b7e', 'request_id': 'req-afad9fa0-f401-4f6a-9c39-61979ec12bd4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.537230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085dd72ef13246f986e2783b1f163b7e', 'request_id': 'req-afad9fa0-f401-4f6a-9c39-61979ec12bd4'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.552622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] The token cache is being invalidate because project 085dd72ef13246f986e2783b1f163b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:56.553064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.555044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.559647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 838/1676] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:56 2022] DELETE /identity/v3/projects/085dd72ef13246f986e2783b1f163b7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:56.562198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:56.564555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:56.652891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:56.699089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023598-e126-45a5-ac2b-6c402d043004 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:56.706508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:56.707859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:56.708334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:56.709544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] PATH_INFO: `/v3/users/14bf698bb5ef40d29075a26f69fc3f28` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:56.712560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bf698bb5ef40d29075a26f69fc3f28)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:56.719730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:56.811204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bf698bb5ef40d29075a26f69fc3f28'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.813413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bf698bb5ef40d29075a26f69fc3f28'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.826195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bf698bb5ef40d29075a26f69fc3f28'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.827905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bf698bb5ef40d29075a26f69fc3f28'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.845271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bf698bb5ef40d29075a26f69fc3f28'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:56.877712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 839/1677] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:56 2022] DELETE /identity/v3/users/14bf698bb5ef40d29075a26f69fc3f28 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:57.127061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:57.129271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:57.236734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad9fa0-f401-4f6a-9c39-61979ec12bd4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:57.382722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:57.384350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:57.385066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:57.385066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] PATH_INFO: `/v3/projects/028f16a1e4964e469ce7caaf59f128dc` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:57.398522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028f16a1e4964e469ce7caaf59f128dc)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:57.401788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:57.513978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028f16a1e4964e469ce7caaf59f128dc', 'request_id': 'req-41045c11-35d4-4d94-be71-ce4468e1c477'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.524124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028f16a1e4964e469ce7caaf59f128dc', 'request_id': 'req-41045c11-35d4-4d94-be71-ce4468e1c477'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.535719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028f16a1e4964e469ce7caaf59f128dc', 'request_id': 'req-41045c11-35d4-4d94-be71-ce4468e1c477'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.549162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:57.557300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] The token cache is being invalidate because project 028f16a1e4964e469ce7caaf59f128dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:57.557704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.558648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-41045c11-35d4-4d94-be71-ce4468e1c477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.565036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 839/1678] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:57 2022] DELETE /identity/v3/projects/028f16a1e4964e469ce7caaf59f128dc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:57.566333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:57.568777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:57.592523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40441-d880-439a-8d16-334f70fbdd33 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:57.671258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:57.671885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:57.672460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:57.704859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:57.705682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:57.706089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:57.706570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] PATH_INFO: `/v3/users/272b68e5b7ef4efaaaa9658e2ddad775` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:57.707902 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272b68e5b7ef4efaaaa9658e2ddad775)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:57.711174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:57.719519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] MFA Rules not processed for user `bac4f7a705d34783a26ac0c09ed3ca9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:57.724382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:57.817003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272b68e5b7ef4efaaaa9658e2ddad775'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.821011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272b68e5b7ef4efaaaa9658e2ddad775'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.837477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:57.845916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272b68e5b7ef4efaaaa9658e2ddad775'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.847140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272b68e5b7ef4efaaaa9658e2ddad775'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.863470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272b68e5b7ef4efaaaa9658e2ddad775'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:57.885100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 840/1679] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:02:57 2022] DELETE /identity/v3/users/272b68e5b7ef4efaaaa9658e2ddad775 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:02:57.886254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:57.888272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:57.923655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 840/1680] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:57.924846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:57.928074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:57.972336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03db4c-245b-47fa-990c-27bc0564eefa None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.032351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79145-009b-4df1-bd42-5b468e8c90e6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.037645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.039069 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.039365 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.039637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] PATH_INFO: `/v3/projects/782db00914684bfab9d6296a93c86c73` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.040949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] RBAC: Authorizing `identity:delete_project(project_id=782db00914684bfab9d6296a93c86c73)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.042878 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.085848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.086781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.087113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.087457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] PATH_INFO: `/v3/projects/20148fec7c03420a9d633abe5b9265d2` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.089314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20148fec7c03420a9d633abe5b9265d2)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.091558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.100643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782db00914684bfab9d6296a93c86c73', 'request_id': 'req-fe407928-7634-44e2-9eb4-fbd12c9a659e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.108652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782db00914684bfab9d6296a93c86c73', 'request_id': 'req-fe407928-7634-44e2-9eb4-fbd12c9a659e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.118322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782db00914684bfab9d6296a93c86c73', 'request_id': 'req-fe407928-7634-44e2-9eb4-fbd12c9a659e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.130339 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] The token cache is being invalidate because project 782db00914684bfab9d6296a93c86c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:58.130636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.131317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-fe407928-7634-44e2-9eb4-fbd12c9a659e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.133159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 841/1681] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:57 2022] DELETE /identity/v3/projects/782db00914684bfab9d6296a93c86c73 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:58.137997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bdd8a-cdb9-461b-ac38-ae773fb871d0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.137997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bdd8a-cdb9-461b-ac38-ae773fb871d0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.137997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bdd8a-cdb9-461b-ac38-ae773fb871d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.157993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20148fec7c03420a9d633abe5b9265d2', 'request_id': 'req-698262ac-4c53-45d0-9df3-123b4770e532'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.162099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-657bdd8a-cdb9-461b-ac38-ae773fb871d0 None None] MFA Rules not processed for user `ea1d6596882a4ec6b0d6ae6fb1ad397e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:58.163376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-657bdd8a-cdb9-461b-ac38-ae773fb871d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.165677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20148fec7c03420a9d633abe5b9265d2', 'request_id': 'req-698262ac-4c53-45d0-9df3-123b4770e532'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.176307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20148fec7c03420a9d633abe5b9265d2', 'request_id': 'req-698262ac-4c53-45d0-9df3-123b4770e532'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.189060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] The token cache is being invalidate because project 20148fec7c03420a9d633abe5b9265d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:58.189378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.190070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-698262ac-4c53-45d0-9df3-123b4770e532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.191652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 841/1682] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:57 2022] DELETE /identity/v3/projects/20148fec7c03420a9d633abe5b9265d2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:58.192883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.193166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.193442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.216360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:58.217582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.228388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:58.235068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 842/1683] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:58.236570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5041c62-3a82-4e40-873c-d0ca6d781285 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.236992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5041c62-3a82-4e40-873c-d0ca6d781285 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.237426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5041c62-3a82-4e40-873c-d0ca6d781285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.254264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:58.264413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d5041c62-3a82-4e40-873c-d0ca6d781285 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:58.266584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d5041c62-3a82-4e40-873c-d0ca6d781285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.292712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 842/1684] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:58.293938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.300836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.348351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 843/1685] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:58.348351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5d03-eb3d-44d5-b32f-b0e5b4a4fed4 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.348351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5d03-eb3d-44d5-b32f-b0e5b4a4fed4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.348351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5d03-eb3d-44d5-b32f-b0e5b4a4fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.372099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-fe2a5d03-eb3d-44d5-b32f-b0e5b4a4fed4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:58.374032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-fe2a5d03-eb3d-44d5-b32f-b0e5b4a4fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.384437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 844/1686] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:58.385811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.386102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.386395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.410344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:58.411560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.424637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 845/1687] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:58.424637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.433697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4941e-575e-475c-9451-1d12f950c390 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.438875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec191b-14e6-4c7d-9572-0d062ac27433 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.440422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.441334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.441625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.441931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.442592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:58.442897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.444773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.446741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.448104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.448581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.449526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.451560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.457221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 846/1688] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:58.460802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.468706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa465b5-1deb-4a6b-8bf4-f47cf5fe8147 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.473774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.474405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.474754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.475279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.476467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:58.476781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.477204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.478494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.479682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.495568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 847/1689] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:58.496403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.508764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 843/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:02:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:02:58.515102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.516763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdde22-1d76-475d-9cbb-1014a9d2a4cd admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.524569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.525351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.526136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.526491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.527375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.530090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.565616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b60c-4ce0-40f7-9bda-dbf60a1f81ca service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.573613 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.574395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.574997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.575545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.576297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.578504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.593021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 848/1691] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:58.595548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.647414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 844/1692] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:58.652269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.723740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6febc-650a-450b-9287-0b053869568c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.773563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325c6e2-0738-43c2-a3ae-b93defbd426f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.794965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.795970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.796536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.797142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.798356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.801319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.853150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:58.871265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.871896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.872180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.872450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.873089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.877229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 845/1693] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:58.877376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.877462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.879139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:58.894991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1b48e-7879-4259-b936-2d973ec1c91d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.901284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.902034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.902316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.902660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] PATH_INFO: `/v3/projects/325a404f7953429383e8a039ea54e711` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.904123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325a404f7953429383e8a039ea54e711)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.905894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 849/1694] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:58 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:58.906300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.907222 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.909800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:58.925108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce14f-373a-409d-9fa5-ae50f98e47c0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.931664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:58.932707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:58.932871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:58.933247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:58.934061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:58.935924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:58.948761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 850/1695] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:58.952008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:58.969298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a3f4-da5f-41e3-8c28-fcaf436358e8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:58.980387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325a404f7953429383e8a039ea54e711', 'request_id': 'req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:58.991169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325a404f7953429383e8a039ea54e711', 'request_id': 'req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:59.006214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325a404f7953429383e8a039ea54e711', 'request_id': 'req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:59.024265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] The token cache is being invalidate because project 325a404f7953429383e8a039ea54e711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:02:59.024782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:59.027735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:02:59.030589 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 846/1696] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:02:58 2022] DELETE /identity/v3/projects/325a404f7953429383e8a039ea54e711 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:59.031904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.033676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:59.091615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194433af-1962-4247-8a53-e8f9f7fbc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.092241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194433af-1962-4247-8a53-e8f9f7fbc247 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.092524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194433af-1962-4247-8a53-e8f9f7fbc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.092795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194433af-1962-4247-8a53-e8f9f7fbc247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.093495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194433af-1962-4247-8a53-e8f9f7fbc247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.095163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194433af-1962-4247-8a53-e8f9f7fbc247 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.111800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 851/1697] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:59.113288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.114114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.114247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.138882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:59.139903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c128c-f76a-4d56-9046-3b06bd09e8d9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.140313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:59.145349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11102fd-9101-4b18-8a97-32c5b10d2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.146098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11102fd-9101-4b18-8a97-32c5b10d2aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.146527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11102fd-9101-4b18-8a97-32c5b10d2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.146951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11102fd-9101-4b18-8a97-32c5b10d2aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.148803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11102fd-9101-4b18-8a97-32c5b10d2aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.150886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11102fd-9101-4b18-8a97-32c5b10d2aa1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.157614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 852/1698] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:59.157614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.157614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:59.168894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753cdfb-661d-41ba-9bc2-ed30854cac07 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.174687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.175424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.175769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.176531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.177309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.180238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.187136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 847/1699] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:59.188923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.189128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.189404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.195570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 853/1700] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:02:59.196492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.213212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e01b4-5741-4066-a5e6-d17dbe94e4f4 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.222713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.223492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.223492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.223776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] PATH_INFO: `/v3/projects/a8756ce7d3c942ebbefe44d8dae281e8/users/57f4792b78184484ae0be87abf78f369/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.232982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:59.234260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:59.248519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 848/1701] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:59.248519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.251765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8756ce7d3c942ebbefe44d8dae281e8, user_id=57f4792b78184484ae0be87abf78f369, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.254850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.266863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49dd58-5919-4cec-80c1-84b39e006f68 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.294954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 854/1702] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:59 2022] PUT /identity/v3/projects/a8756ce7d3c942ebbefe44d8dae281e8/users/57f4792b78184484ae0be87abf78f369/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:59.295832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.375797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.376419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.376708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.377080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] PATH_INFO: `/v3/projects/2e2c7a1bb1de4764b99f34f49fcd183b/users/328c8a844a824c119dc9e0ff78f28f9b/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.392905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919a55-9b98-41c8-8af4-9f5b566fc11d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.403845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.404468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.404753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.405184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.405965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:02:59.406298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.407891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60f67-0f23-4816-a775-6fcfe464901e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.412506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2c7a1bb1de4764b99f34f49fcd183b, user_id=328c8a844a824c119dc9e0ff78f28f9b, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.415788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.433875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 855/1703] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:02:59.438644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ae1a-406b-4fd7-9a14-b8c1499ad611 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.438929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ae1a-406b-4fd7-9a14-b8c1499ad611 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.439196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ae1a-406b-4fd7-9a14-b8c1499ad611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.440632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 849/1704] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:02:59 2022] PUT /identity/v3/projects/2e2c7a1bb1de4764b99f34f49fcd183b/users/328c8a844a824c119dc9e0ff78f28f9b/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:02:59.441664 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.459666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:59.485369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2713ae1a-406b-4fd7-9a14-b8c1499ad611 None None] MFA Rules not processed for user `57f4792b78184484ae0be87abf78f369`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:59.487179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2713ae1a-406b-4fd7-9a14-b8c1499ad611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:59.500847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:59.538969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180edacd-8e84-43cd-9a24-3defa2195b7c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.548666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.549285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.549731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.550104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.558564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.559941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.596535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 856/1705] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:59.598183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 850/1706] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:59.602090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.605587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.606149 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.606677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.652789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] MFA Rules not processed for user `328c8a844a824c119dc9e0ff78f28f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:02:59.654788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:02:59.724028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e51a4-82db-4651-b09f-219273c2e0e7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.740168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.740904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.741187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.742525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.743668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.748765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:02:59.807072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 857/1707] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:02:59.808045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.842498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96b2a1-3c41-4ffd-959a-1dee31f5831f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:02:59.847362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 851/1708] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:02:59.849780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:02:59.978238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:02:59.979249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:02:59.979748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:02:59.980124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:02:59.981045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:02:59.982833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.010600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c4c8-d2e6-4b15-977d-c524d539a337 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.016219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 858/1709] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:00.016219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.016452 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.017120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.017414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.017688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.018562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.020502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.029357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a805c8-76a3-473b-ad6e-5e2bc74c161b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.034793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.035408 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.035687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.035961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.036592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.039887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.062115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:00.075009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 859/1710] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:00 2022] POST /identity/v3/users => generated 290 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:00.078746 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.078890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 852/1711] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:02:59 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:00.079784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.103978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d8bf-1725-4731-affd-8d1707e7a67a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.124558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:00.238926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5aeb-65f0-41f3-8cc8-ff3b1e2db758 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.250766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.252210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.253121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.255028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.255794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.261245 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.268640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.269269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.269547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.269844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.270930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.274238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.296764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 853/1712] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:00.298169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.327789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd59c9-8d46-4d76-a09b-1d923748564f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.341875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 860/1713] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:00.342834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.345665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.347793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.349783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.350157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.351680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.357171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.368181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a06e-6b22-466b-aac3-e12f86b6b291 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.374156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.374939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.375397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.375763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] PATH_INFO: `/v3/projects/13c9b34fc55148c68284d39eb52e825e/users/a1d96d15c5f246f3bda0978655193795/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.417467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 854/1714] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:00 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:00.418631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.430687 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb0128-b742-4e9e-8f8c-9c81374eeb73 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.431800 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c9b34fc55148c68284d39eb52e825e, user_id=a1d96d15c5f246f3bda0978655193795, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.436543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.437251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.437541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.437832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.438520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.439064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.440948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.459135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 855/1715] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:00.459135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.468873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 861/1716] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:00 2022] PUT /identity/v3/projects/13c9b34fc55148c68284d39eb52e825e/users/a1d96d15c5f246f3bda0978655193795/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:00.473023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.475824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eda156-8a36-457d-b1a0-b57d8596020c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.620874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99fcb-15de-4e43-825e-c6315ad5341f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.627830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.628534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.628908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.629214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] PATH_INFO: `/v3/projects/db077ff9d4504d20a3f2fd1dbb43d46d/users/7bf95321b9554800ad86194f1560b1c1/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.652268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db077ff9d4504d20a3f2fd1dbb43d46d, user_id=7bf95321b9554800ad86194f1560b1c1, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.657238 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.673033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2ada-8f5d-4a0d-98ca-18ea28c1e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.674358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2ada-8f5d-4a0d-98ca-18ea28c1e559 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.674496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 862/1717] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:00 2022] PUT /identity/v3/projects/db077ff9d4504d20a3f2fd1dbb43d46d/users/7bf95321b9554800ad86194f1560b1c1/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:00.674924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2ada-8f5d-4a0d-98ca-18ea28c1e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.675327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2ada-8f5d-4a0d-98ca-18ea28c1e559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.675425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.676412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f2ada-8f5d-4a0d-98ca-18ea28c1e559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.678279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f2ada-8f5d-4a0d-98ca-18ea28c1e559 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.695528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 856/1718] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:00.695528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.695528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.695528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.751614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] MFA Rules not processed for user `7bf95321b9554800ad86194f1560b1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:00.755476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:00.799879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746a214-4910-4648-8406-c69a7b4d38e3 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.814517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.815156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.815431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.815698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.816353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.818079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.840040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 863/1719] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:00.841335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.853987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:00.859701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df7c67-db2f-4f4b-9eae-f46d621deafa admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:00.870206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:00.877045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:00.877782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:00.878124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] PATH_INFO: `/v3/projects/80b971dab2ec47f18f269b4573535ef2/users/3d9c561cb2ad4ed386c8c34e58bf2912/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:00.905586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b971dab2ec47f18f269b4573535ef2, user_id=3d9c561cb2ad4ed386c8c34e58bf2912, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:00.909880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:00.946755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:00.963020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 857/1720] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:00.963663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.967042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 864/1721] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:00 2022] PUT /identity/v3/projects/80b971dab2ec47f18f269b4573535ef2/users/3d9c561cb2ad4ed386c8c34e58bf2912/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:00.972637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:00.995761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.017290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb1702-4a25-4a8d-8773-aac3f8b11d9b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:01.166645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbca7c-0c26-4309-8bab-dc4101fe6cf9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:01.171961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:01.172600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.172931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.173206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] PATH_INFO: `/v3/users/4cb7bc700b734fef8777272472241949` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.174358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb7bc700b734fef8777272472241949)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:01.176795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:01.176939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:01.177864 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.178251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.178626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] PATH_INFO: `/v3/projects/13c9b34fc55148c68284d39eb52e825e/users/a1d96d15c5f246f3bda0978655193795/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.182122 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c9b34fc55148c68284d39eb52e825e, user_id=a1d96d15c5f246f3bda0978655193795, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:01.185054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:01.202007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 858/1722] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:00 2022] PUT /identity/v3/projects/13c9b34fc55148c68284d39eb52e825e/users/a1d96d15c5f246f3bda0978655193795/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:01.203031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:01.252799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb7bc700b734fef8777272472241949'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:01.253631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb7bc700b734fef8777272472241949'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:01.273202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb7bc700b734fef8777272472241949'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:01.275843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb7bc700b734fef8777272472241949'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:01.291834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb116dcf-4c3e-41dc-9fea-9aec694d3860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb7bc700b734fef8777272472241949'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:01.303206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74ae67-0633-4bec-b00a-94e7eada3c57 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:01.308174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:01.310046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.310046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.310046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.310303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:01.312285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:01.330671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 859/1723] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:01.331399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:01.338442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 865/1724] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:00 2022] DELETE /identity/v3/users/4cb7bc700b734fef8777272472241949 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:01.339980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.340116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.340331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.341933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.376764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] MFA Rules not processed for user `a1d96d15c5f246f3bda0978655193795`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:01.378747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.439102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:01.501967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 866/1725] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:01.511242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:01.516036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.522600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12042300-ce39-4d10-8480-e40504d906f6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:01.566016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:01.636234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:01.637940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.638222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.638710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.641377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.681574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f1ab-ac68-43b3-8df3-7985f518e20c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:01.689844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e8ad4-f16b-4698-9ffa-89601d7abbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:01.690537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e8ad4-f16b-4698-9ffa-89601d7abbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.690813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e8ad4-f16b-4698-9ffa-89601d7abbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.691086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e8ad4-f16b-4698-9ffa-89601d7abbaf admin admin] PATH_INFO: `/v3/projects/80b971dab2ec47f18f269b4573535ef2/users/3d9c561cb2ad4ed386c8c34e58bf2912/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.694798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e8ad4-f16b-4698-9ffa-89601d7abbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b971dab2ec47f18f269b4573535ef2, user_id=3d9c561cb2ad4ed386c8c34e58bf2912, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:01.699204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e8ad4-f16b-4698-9ffa-89601d7abbaf admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:01.726884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 867/1726] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:01 2022] PUT /identity/v3/projects/80b971dab2ec47f18f269b4573535ef2/users/3d9c561cb2ad4ed386c8c34e58bf2912/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:01.734021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02083962-47aa-40b1-8dac-ee15652250b4 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.734021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02083962-47aa-40b1-8dac-ee15652250b4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.734021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02083962-47aa-40b1-8dac-ee15652250b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.734279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:01.734279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:01.744543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 860/1727] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:01.745411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:01.746903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.762617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-02083962-47aa-40b1-8dac-ee15652250b4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:01.764218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-02083962-47aa-40b1-8dac-ee15652250b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:01.843693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1d544-91bd-46f9-a94f-41eb92bdeeb1 service glance] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:01.891296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 868/1728] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:01.892814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.893103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.893381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.915920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:01.916722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:01.917096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:01.917465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:01.937835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] MFA Rules not processed for user `3d9c561cb2ad4ed386c8c34e58bf2912`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:01.939154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:02.089878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:02.106306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 869/1729] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:02.107560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:02.109327 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:02.131402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:02.146162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:02.148213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:02.179419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 861/1730] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:02.240496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e537f5-2361-447e-acc9-5f2c26751d0f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:02.271233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:02.272409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:02.272975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:02.273513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:02.294973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:02.296366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:02.299127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:02.304335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1806f4-0a94-4df6-b028-d1c391f56886 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:02.311503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 870/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:02.311690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:02.312253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:02.312528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:02.313835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:02.329416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:02.337672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:02.366043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 862/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:02.700631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:02.702506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:02.723422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7c91-adce-4114-b4b2-6805acd18406 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:02.736370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:02.736370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:02.736370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:02.736370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:02.740375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:02.799678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:02.820362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180e2b7-5522-4296-b22a-4eb0213009e4 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:02.828435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:02.829056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:02.829334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:02.829614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:02.833482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:02.883613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:02.885201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:02.898671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 871/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:02.927663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:02.929684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:02.935449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:02.942661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:02.955111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c492a1-511e-4152-b707-8645e55f5958 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:02.966346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:02.966346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:02.966346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:02.966346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] PATH_INFO: `/v3/projects/eeec8fec5c2245288b23bf2f04bb97f2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:02.967078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeec8fec5c2245288b23bf2f04bb97f2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:02.969727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:02.985223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 863/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:03.059409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeec8fec5c2245288b23bf2f04bb97f2', 'request_id': 'req-0bf90963-0dcf-4ace-9ea3-88673654bd2e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.068554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeec8fec5c2245288b23bf2f04bb97f2', 'request_id': 'req-0bf90963-0dcf-4ace-9ea3-88673654bd2e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.079824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeec8fec5c2245288b23bf2f04bb97f2', 'request_id': 'req-0bf90963-0dcf-4ace-9ea3-88673654bd2e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.095142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] The token cache is being invalidate because project eeec8fec5c2245288b23bf2f04bb97f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:03.095441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.096279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.098710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 872/1735] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:02 2022] DELETE /identity/v3/projects/eeec8fec5c2245288b23bf2f04bb97f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:03.104343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:03.122917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a3dc-0577-4093-a53d-fe5db92d7010 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:03.221840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:03.222845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:03.223482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:03.223825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] PATH_INFO: `/v3/users/f901b3e9537743a48fedb236274a0f9a` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:03.231898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f901b3e9537743a48fedb236274a0f9a)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:03.238557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:03.330314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f901b3e9537743a48fedb236274a0f9a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.348246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f901b3e9537743a48fedb236274a0f9a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.354311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f901b3e9537743a48fedb236274a0f9a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.368231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f901b3e9537743a48fedb236274a0f9a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.368897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f901b3e9537743a48fedb236274a0f9a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.388273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:03.416823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 864/1736] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:03 2022] DELETE /identity/v3/users/f901b3e9537743a48fedb236274a0f9a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:03.702228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:03.704655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:03.722710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf90963-0dcf-4ace-9ea3-88673654bd2e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:03.753146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:03.791023 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:03.791663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:03.793541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:03.793858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] PATH_INFO: `/v3/users/328c8a844a824c119dc9e0ff78f28f9b` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:03.795026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328c8a844a824c119dc9e0ff78f28f9b)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:03.796941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:03.860578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:03.862384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328c8a844a824c119dc9e0ff78f28f9b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.862814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:03.864407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328c8a844a824c119dc9e0ff78f28f9b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.875731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328c8a844a824c119dc9e0ff78f28f9b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.876475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328c8a844a824c119dc9e0ff78f28f9b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.892536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df35d-2748-4291-b65f-f9a83be11ef5 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:03.893405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-441228fc-f44e-49e3-a462-0dc3a0ff7261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328c8a844a824c119dc9e0ff78f28f9b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.898617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:03.899258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:03.899534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:03.899808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] PATH_INFO: `/v3/projects/cbab38d345884246b95819eb456c2a8b` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:03.900936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbab38d345884246b95819eb456c2a8b)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:03.902862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:03.934842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 873/1737] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:03 2022] DELETE /identity/v3/users/328c8a844a824c119dc9e0ff78f28f9b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:03.940160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:03.940633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:03.940903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:03.963184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:03.964403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:03.972304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbab38d345884246b95819eb456c2a8b', 'request_id': 'req-95aa07f4-cc84-4243-9a4d-d30a4967d11b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:03.994670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbab38d345884246b95819eb456c2a8b', 'request_id': 'req-95aa07f4-cc84-4243-9a4d-d30a4967d11b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:04.006484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbab38d345884246b95819eb456c2a8b', 'request_id': 'req-95aa07f4-cc84-4243-9a4d-d30a4967d11b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:04.025029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] The token cache is being invalidate because project cbab38d345884246b95819eb456c2a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:04.025620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:04.026668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-95aa07f4-cc84-4243-9a4d-d30a4967d11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:04.032261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 865/1738] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:03 2022] DELETE /identity/v3/projects/cbab38d345884246b95819eb456c2a8b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:04.034068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab1891-2c5c-4831-a73c-bac0d709b329 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.035032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab1891-2c5c-4831-a73c-bac0d709b329 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.035436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab1891-2c5c-4831-a73c-bac0d709b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.043840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 874/1739] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:04.066704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.068673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:04.070570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a4ab1891-2c5c-4831-a73c-bac0d709b329 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:04.076244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a4ab1891-2c5c-4831-a73c-bac0d709b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:04.091655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 866/1740] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:04.099719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.099719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.100055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.122272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:04.123514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:04.134825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:04.154049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f1eb8-dc01-4e7a-8e1e-0c50d8d1ef84 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.158049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 867/1741] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:04.167173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.168061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.168579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.169484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.173895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.193908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58970da-7fa4-44f1-b265-584552c37526 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.196504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.197988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.200150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.200774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.201048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.201676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.202430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:04.202739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.204347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.216939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 868/1742] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:04.219601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 875/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:04.221242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.233012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7736f81-b271-4506-a006-60da631765eb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.238168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.238859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.239216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.239566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.240282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.243045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.278301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 869/1744] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:04 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:04.282605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.296533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97b15-b630-4695-8aee-ad043c7a2a8e service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.369305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.369711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.370025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.370298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.370937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.372903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.403146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 876/1745] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:04 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:04.407643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.421607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fee00-1026-46fb-92aa-24f727a1ba8b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.426262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.426849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.427434 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.427610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.428241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.430993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.443983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 870/1746] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:04.447855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.458887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc957f5-e3d2-4005-9823-39ee675cf362 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.466781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ee1e-9719-4e6f-8eca-4d8a072c01c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.467505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ee1e-9719-4e6f-8eca-4d8a072c01c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.467783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ee1e-9719-4e6f-8eca-4d8a072c01c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.468194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ee1e-9719-4e6f-8eca-4d8a072c01c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.469221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28ee1e-9719-4e6f-8eca-4d8a072c01c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.472359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28ee1e-9719-4e6f-8eca-4d8a072c01c4 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.486725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 877/1747] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:04.490609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.506202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68581b8-2a9f-40a9-904e-4bcd34bef587 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.517498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.518282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.518566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.518842 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] PATH_INFO: `/v3/projects/d499d0ee5cfc4f74a3b17cc659799ee7/users/b4d547c3a5b949108f45753225060da1/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.541115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d499d0ee5cfc4f74a3b17cc659799ee7, user_id=b4d547c3a5b949108f45753225060da1, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.544186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.565479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 871/1748] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:04 2022] PUT /identity/v3/projects/d499d0ee5cfc4f74a3b17cc659799ee7/users/b4d547c3a5b949108f45753225060da1/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:04.577021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.577302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.577571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.615446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] MFA Rules not processed for user `b4d547c3a5b949108f45753225060da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:04.620088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:04.725524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 878/1749] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:04.730731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.767662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:04.769048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:04.864737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:04.910835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a49e9-1809-411b-891e-2850f3468d6f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.938286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.939209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.939674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.941413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.942387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.948059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:04.948696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.959301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4bd65-a3b6-4518-b0b6-c547063904b1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:04.986063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:04.987336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:04.988296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:04.989116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] PATH_INFO: `/v3/projects/2e2c7a1bb1de4764b99f34f49fcd183b` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:04.990583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2c7a1bb1de4764b99f34f49fcd183b)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:04.994230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:04.998923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 872/1750] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:04 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:05.006216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.068079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2c7a1bb1de4764b99f34f49fcd183b', 'request_id': 'req-8c1b3815-f2da-4640-8565-fef7c91b4a1c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.094889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2c7a1bb1de4764b99f34f49fcd183b', 'request_id': 'req-8c1b3815-f2da-4640-8565-fef7c91b4a1c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.107929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2c7a1bb1de4764b99f34f49fcd183b', 'request_id': 'req-8c1b3815-f2da-4640-8565-fef7c91b4a1c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.123488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] The token cache is being invalidate because project 2e2c7a1bb1de4764b99f34f49fcd183b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:05.123793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.124258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0207769-9f3e-4ae5-a8b3-d4419982a8b4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.124437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.127043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 879/1751] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:04 2022] DELETE /identity/v3/projects/2e2c7a1bb1de4764b99f34f49fcd183b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:05.130810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.132289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:05.211377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.212082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.212428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.212776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.213475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.215796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.221948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b3815-f2da-4640-8565-fef7c91b4a1c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.229221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.230043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.230428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.230801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] PATH_INFO: `/v3/users/3d9c561cb2ad4ed386c8c34e58bf2912` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.232328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9c561cb2ad4ed386c8c34e58bf2912)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.235116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.252678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 873/1752] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:05 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:05.259809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.263284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:05.278368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab3809-ea2b-4b0e-97c1-6ec8795ba0e1 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.285365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.286414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.286835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.287205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.287969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.290875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.311732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 874/1753] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:05.312690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.330725 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214502-63cc-448c-b715-fabc5fafc3f6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.340199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.341087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.342041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.342354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] PATH_INFO: `/v3/projects/56251e0e6c57485d88041a5141f7ede4/users/62a343d7a30842669131ab3787554f32/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.362444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9c561cb2ad4ed386c8c34e58bf2912'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.364616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9c561cb2ad4ed386c8c34e58bf2912'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.374011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9c561cb2ad4ed386c8c34e58bf2912'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.374756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9c561cb2ad4ed386c8c34e58bf2912'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.382117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56251e0e6c57485d88041a5141f7ede4, user_id=62a343d7a30842669131ab3787554f32, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.386498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.388307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9c561cb2ad4ed386c8c34e58bf2912'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.418643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 880/1754] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:05 2022] DELETE /identity/v3/users/3d9c561cb2ad4ed386c8c34e58bf2912 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:05.424914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 875/1755] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:05 2022] PUT /identity/v3/projects/56251e0e6c57485d88041a5141f7ede4/users/62a343d7a30842669131ab3787554f32/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:05.426008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.427735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:05.440328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:05.520600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a25305-47f0-40ca-a54a-fbe79f75c417 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.527267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d40fd8-6167-4f40-8721-c65aeaf54fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.527597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d40fd8-6167-4f40-8721-c65aeaf54fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.527957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d40fd8-6167-4f40-8721-c65aeaf54fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.528293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d40fd8-6167-4f40-8721-c65aeaf54fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.529035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d40fd8-6167-4f40-8721-c65aeaf54fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.530710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d40fd8-6167-4f40-8721-c65aeaf54fcb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.545046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 881/1756] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:05.549527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.601576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:05.638608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ae48b-3b6d-4b04-8881-c3cb576dfe1a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.643564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.644326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.644646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.644982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] PATH_INFO: `/v3/projects/56251e0e6c57485d88041a5141f7ede4/users/62a343d7a30842669131ab3787554f32/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.647135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56251e0e6c57485d88041a5141f7ede4, user_id=62a343d7a30842669131ab3787554f32, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.652135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.664158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 876/1757] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:05 2022] PUT /identity/v3/projects/56251e0e6c57485d88041a5141f7ede4/users/62a343d7a30842669131ab3787554f32/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:05.675308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.675482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.675728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.710680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] MFA Rules not processed for user `62a343d7a30842669131ab3787554f32`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:05.712665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:05.795918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.797779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:05.803007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 882/1758] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:05.812484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:05.814556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:05.881984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d1603-ab61-4784-9d6e-f2733a59231e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.882342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e45a8-6aa2-4e6c-81fa-499c6df89111 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:05.885785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d823f5-7c46-44a8-a429-2db88a21a656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.886414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d823f5-7c46-44a8-a429-2db88a21a656 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.886689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d823f5-7c46-44a8-a429-2db88a21a656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.886954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d823f5-7c46-44a8-a429-2db88a21a656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.887303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:05.887831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:05.888105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:05.888372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] PATH_INFO: `/v3/projects/80b971dab2ec47f18f269b4573535ef2` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:05.889470 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b971dab2ec47f18f269b4573535ef2)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.891388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.896347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d823f5-7c46-44a8-a429-2db88a21a656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:05.898207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d823f5-7c46-44a8-a429-2db88a21a656 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:05.908502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 883/1759] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:05.956123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b971dab2ec47f18f269b4573535ef2', 'request_id': 'req-97898393-4efc-4d53-a680-139a7b53c6ed'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.962756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b971dab2ec47f18f269b4573535ef2', 'request_id': 'req-97898393-4efc-4d53-a680-139a7b53c6ed'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:05.973099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b971dab2ec47f18f269b4573535ef2', 'request_id': 'req-97898393-4efc-4d53-a680-139a7b53c6ed'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:06.001149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] The token cache is being invalidate because project 80b971dab2ec47f18f269b4573535ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:06.001545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:06.002458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-97898393-4efc-4d53-a680-139a7b53c6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:06.004237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 877/1760] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:05 2022] DELETE /identity/v3/projects/80b971dab2ec47f18f269b4573535ef2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:06.012014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.012014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.012014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.051130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:06.051863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:06.088376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:06.137815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 884/1761] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:06.145673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.146002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.146374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.177500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:06.179489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:06.191479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 878/1762] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:06.196039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.214678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a67fd0-a9a4-4617-8cf5-45c1322da916 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.220877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.221837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.222283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.222543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.223297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:06.223724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.227343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.247779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 885/1763] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:06.251913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.266283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92da6ac-2c9b-4a08-94a5-96d902f0e2ed None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.271707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.272615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.272894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.273164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.274241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.276222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.313934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 879/1764] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:06 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:06.316733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.337171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bd59-894b-491e-9b42-3f463fcd7c3d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.409887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.410502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.410786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.411055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.411796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.414006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.439422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 886/1765] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:06 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:06.443961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.457557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89784e0e-a499-4863-b126-9a6af6daf567 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.465783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.468626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.468626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.468626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.468626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.470240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.492547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.501494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 880/1766] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:06.509353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea84d9f-0d43-4e45-872d-31b8871be530 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.522284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c1781-0729-4b89-90a0-d2f6a521cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.522284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1781-0729-4b89-90a0-d2f6a521cef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.522284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1781-0729-4b89-90a0-d2f6a521cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.522284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1781-0729-4b89-90a0-d2f6a521cef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.523477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c1781-0729-4b89-90a0-d2f6a521cef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.525041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c1781-0729-4b89-90a0-d2f6a521cef5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.539317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 887/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:06.543620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.555963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7cbe8-14e4-4469-a0fa-769de1d850d4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.562268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.563254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.563638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.564014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] PATH_INFO: `/v3/projects/eede50f59cf041d19edde7c4ac1ff1b8/users/28a19a34d6c54b699b9764c9d707dc79/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.595119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:06.602381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eede50f59cf041d19edde7c4ac1ff1b8, user_id=28a19a34d6c54b699b9764c9d707dc79, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.609607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.628056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 881/1768] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:06 2022] PUT /identity/v3/projects/eede50f59cf041d19edde7c4ac1ff1b8/users/28a19a34d6c54b699b9764c9d707dc79/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:06.643165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.644259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.644536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.688869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] MFA Rules not processed for user `28a19a34d6c54b699b9764c9d707dc79`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:06.691118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:06.804624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 888/1769] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:06.824744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:06.827028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:06.908500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b1e5-c8a2-403f-bc7d-7e5615887e92 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:06.910461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b825-f1fb-45ef-bc4b-764430393a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:06.911170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b825-f1fb-45ef-bc4b-764430393a6a service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:06.911516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b825-f1fb-45ef-bc4b-764430393a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:06.911854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b825-f1fb-45ef-bc4b-764430393a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:06.922635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7b825-f1fb-45ef-bc4b-764430393a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:06.924543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7b825-f1fb-45ef-bc4b-764430393a6a service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:06.935175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 882/1770] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:07.877468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:07.879043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:07.913931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:07.949395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94b218-274d-4dcd-8617-b689f6360fbe None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:07.953789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:07.954439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:07.954715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:07.954980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] PATH_INFO: `/v3/users/b4d547c3a5b949108f45753225060da1` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:07.956109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d547c3a5b949108f45753225060da1)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:07.958036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:08.006414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d547c3a5b949108f45753225060da1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.007797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d547c3a5b949108f45753225060da1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.015039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d547c3a5b949108f45753225060da1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.015664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d547c3a5b949108f45753225060da1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.023161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d547c3a5b949108f45753225060da1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.044932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 889/1771] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:07 2022] DELETE /identity/v3/users/b4d547c3a5b949108f45753225060da1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:08.049378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:08.049869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:08.049958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:08.072080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:08.073627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:08.137577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 883/1772] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:08.147603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:08.149422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:08.215199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5a5cb-98bf-440b-b8de-b2dec9b2e337 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:08.218780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:08.219378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:08.219650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:08.219919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:08.229509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:08.231178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:08.240904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 890/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:08.528612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:08.531296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:08.546001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77543-affb-411c-8327-23d2cc000843 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:08.571265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:08.572272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:08.572731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:08.573056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] PATH_INFO: `/v3/projects/d499d0ee5cfc4f74a3b17cc659799ee7` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:08.574823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d499d0ee5cfc4f74a3b17cc659799ee7)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:08.577079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:08.643630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd499d0ee5cfc4f74a3b17cc659799ee7', 'request_id': 'req-01771092-4f3e-417f-870b-d15013795b1c'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.653099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd499d0ee5cfc4f74a3b17cc659799ee7', 'request_id': 'req-01771092-4f3e-417f-870b-d15013795b1c'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.663880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd499d0ee5cfc4f74a3b17cc659799ee7', 'request_id': 'req-01771092-4f3e-417f-870b-d15013795b1c'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.683164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] The token cache is being invalidate because project d499d0ee5cfc4f74a3b17cc659799ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:08.683296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.684072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.688910 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 884/1774] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:08 2022] DELETE /identity/v3/projects/d499d0ee5cfc4f74a3b17cc659799ee7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:08.690860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:08.704379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819aff9-d2f2-4fda-a686-786386be048c service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:08.761943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:08.782711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:08.783509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:08.783863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:08.784175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] PATH_INFO: `/v3/users/62a343d7a30842669131ab3787554f32` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:08.785634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a343d7a30842669131ab3787554f32)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:08.791711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:08.812678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:08.816172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:08.829576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01771092-4f3e-417f-870b-d15013795b1c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:08.835403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:08.836048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:08.836327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:08.836604 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] PATH_INFO: `/v3/users/57f4792b78184484ae0be87abf78f369` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:08.837800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f4792b78184484ae0be87abf78f369)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:08.840288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:08.855824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:08.868200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a343d7a30842669131ab3787554f32'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.869281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a343d7a30842669131ab3787554f32'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.882634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a343d7a30842669131ab3787554f32'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.884076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a343d7a30842669131ab3787554f32'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.893197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a1a947a-5c6f-4c25-80ac-e9f89ee9ffa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a343d7a30842669131ab3787554f32'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.919862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f4792b78184484ae0be87abf78f369'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.920397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 891/1775] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:08 2022] DELETE /identity/v3/users/62a343d7a30842669131ab3787554f32 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:08.933381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f4792b78184484ae0be87abf78f369'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.934461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f4792b78184484ae0be87abf78f369'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.947881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f4792b78184484ae0be87abf78f369'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.948950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f4792b78184484ae0be87abf78f369'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:08.980587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 885/1776] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:08 2022] DELETE /identity/v3/users/57f4792b78184484ae0be87abf78f369 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:08.986158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:08.987007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:08.987463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.017446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:09.019052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:09.104581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 892/1777] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:09.127798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:09.130805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:09.262255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7285c3-2d0b-4784-80b0-384bcbb0aeb8 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:09.266162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a1ab-1124-4f57-9962-864b442e4bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:09.266778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a1ab-1124-4f57-9962-864b442e4bfc service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:09.267217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a1ab-1124-4f57-9962-864b442e4bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:09.267663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a1ab-1124-4f57-9962-864b442e4bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.289202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39a1ab-1124-4f57-9962-864b442e4bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:09.290957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39a1ab-1124-4f57-9962-864b442e4bfc service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:09.301383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 886/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:09.453072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:09.454706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:09.475183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb918ab-2c3e-4814-91ae-dd8bb8fe5b7c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:09.483543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:09.484206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:09.484489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:09.484765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] PATH_INFO: `/v3/projects/56251e0e6c57485d88041a5141f7ede4` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.485952 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56251e0e6c57485d88041a5141f7ede4)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:09.488240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:09.553409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56251e0e6c57485d88041a5141f7ede4', 'request_id': 'req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.564838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56251e0e6c57485d88041a5141f7ede4', 'request_id': 'req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.576838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56251e0e6c57485d88041a5141f7ede4', 'request_id': 'req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.589186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:09.605379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] The token cache is being invalidate because project 56251e0e6c57485d88041a5141f7ede4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:09.605769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.606469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.608649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 893/1779] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:09 2022] DELETE /identity/v3/projects/56251e0e6c57485d88041a5141f7ede4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:09.613732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37eff5-f022-458e-b62f-63974374626a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:09.614089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37eff5-f022-458e-b62f-63974374626a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:09.614374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37eff5-f022-458e-b62f-63974374626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.635665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-0c37eff5-f022-458e-b62f-63974374626a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:09.637324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0c37eff5-f022-458e-b62f-63974374626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:09.726539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:09.728278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:09.733808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 887/1780] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:09.741182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:09.742761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:09.743116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.751050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5c08-fd0f-4acc-85b7-2ca962f0e17a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:09.763940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:09.769708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:09.770056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:09.770342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] PATH_INFO: `/v3/projects/a8756ce7d3c942ebbefe44d8dae281e8` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.773163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8756ce7d3c942ebbefe44d8dae281e8)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:09.775106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:09.781916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:09.783262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:09.799389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 888/1781] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:09.803763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:09.822216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4b3eb-ec8d-4f2e-bab2-fadcdb217d96 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:09.832897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:09.833937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:09.834412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:09.834838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:09.837089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:09.837565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:09.839465 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:09.844204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8756ce7d3c942ebbefe44d8dae281e8', 'request_id': 'req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.854602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8756ce7d3c942ebbefe44d8dae281e8', 'request_id': 'req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.858222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 889/1782] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:03:09.861002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:09.868933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8756ce7d3c942ebbefe44d8dae281e8', 'request_id': 'req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.875768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e525-5657-45dc-ac9d-257c7f6f1183 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:09.887273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:09.888291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] The token cache is being invalidate because project a8756ce7d3c942ebbefe44d8dae281e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:09.889927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.890330 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:09.894750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 894/1783] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:09 2022] DELETE /identity/v3/projects/a8756ce7d3c942ebbefe44d8dae281e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:09.899274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:09.901475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:10.025260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:10.026014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.026295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.026567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.027450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:10.030694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:10.052187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e873fa-14b7-40f2-95f3-e3f7d4aca24e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:10.061425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:10.062118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.062396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.064537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] PATH_INFO: `/v3/users/a1d96d15c5f246f3bda0978655193795` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.064537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d96d15c5f246f3bda0978655193795)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:10.065755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:10.094709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 890/1784] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:09 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:10.099579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:10.106805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:10.150756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d96d15c5f246f3bda0978655193795'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:10.152108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d96d15c5f246f3bda0978655193795'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:10.170269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d96d15c5f246f3bda0978655193795'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:10.172133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d96d15c5f246f3bda0978655193795'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:10.185277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d96d15c5f246f3bda0978655193795'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:10.208442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:10.233879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 895/1785] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:09 2022] DELETE /identity/v3/users/a1d96d15c5f246f3bda0978655193795 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:10.283603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad783cb-3e7f-4e4a-9195-d71be28b43f4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:10.415073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:10.416558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.416933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.417218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.418311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:10.421336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:10.449775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 891/1786] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:10 2022] POST /identity/v3/users => generated 294 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:10.454580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:10.456130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:10.475088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0e8e5-ce2e-454e-b556-02e97a15416c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:10.481539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:10.482281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.482578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.482866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.483518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:10.485287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:10.504753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 896/1787] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:10.507997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:10.533709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3d55-e4ba-4c91-9b7e-f43efd3ad373 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:10.546306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7e66-0463-424f-8c2c-5d6f43f9d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:10.547110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7e66-0463-424f-8c2c-5d6f43f9d522 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.547110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7e66-0463-424f-8c2c-5d6f43f9d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.548340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7e66-0463-424f-8c2c-5d6f43f9d522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.548340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7e66-0463-424f-8c2c-5d6f43f9d522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:10.550044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7e66-0463-424f-8c2c-5d6f43f9d522 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:10.594882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 892/1788] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:10.599082 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:10.639191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdecd8-947d-4853-9f0f-9fe4b98c4aaf admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:10.652225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:10.653007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.653295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.653661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] PATH_INFO: `/v3/projects/9db153b3841240039660f69946aecef4/users/b92eec6d42da4b37932ee1603f06f30b/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.676392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db153b3841240039660f69946aecef4, user_id=b92eec6d42da4b37932ee1603f06f30b, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:10.680789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:10.706795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 897/1789] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:10 2022] PUT /identity/v3/projects/9db153b3841240039660f69946aecef4/users/b92eec6d42da4b37932ee1603f06f30b/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:10.717225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ded3-6669-48de-8402-02d33716298b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:10.717884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ded3-6669-48de-8402-02d33716298b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:10.718423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ded3-6669-48de-8402-02d33716298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:10.801863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-fa73ded3-6669-48de-8402-02d33716298b None None] MFA Rules not processed for user `b92eec6d42da4b37932ee1603f06f30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:10.804659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fa73ded3-6669-48de-8402-02d33716298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:10.839294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:10.840396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:10.843213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:10.973972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e2c7-14ac-4956-acb2-1c43063b2891 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:10.976391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 893/1790] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:10.985456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73ded3-6669-48de-8402-02d33716298b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:10.989497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.002282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.002282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.002282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] PATH_INFO: `/v3/projects/13c9b34fc55148c68284d39eb52e825e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.002683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73ded3-6669-48de-8402-02d33716298b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.003497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c9b34fc55148c68284d39eb52e825e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.005715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.012938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.014051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.014333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.014767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.019519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.026514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.077454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c9b34fc55148c68284d39eb52e825e', 'request_id': 'req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:11.082319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 894/1791] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:10 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:11.087048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.092301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c9b34fc55148c68284d39eb52e825e', 'request_id': 'req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:11.103332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c9b34fc55148c68284d39eb52e825e', 'request_id': 'req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:11.123021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] The token cache is being invalidate because project 13c9b34fc55148c68284d39eb52e825e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:11.123240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:11.124028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3465f4e9-ab12-4d83-acc8-75b1a43a8ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:11.130914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 898/1792] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:10 2022] DELETE /identity/v3/projects/13c9b34fc55148c68284d39eb52e825e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:11.133105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb637-d21d-4f22-8f0c-ea741e45dab7 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.133444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb637-d21d-4f22-8f0c-ea741e45dab7 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.133733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb637-d21d-4f22-8f0c-ea741e45dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.162729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ecfdb637-d21d-4f22-8f0c-ea741e45dab7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:11.164571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ecfdb637-d21d-4f22-8f0c-ea741e45dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:11.231787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:11.249839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c4c8-578b-4051-a53d-a75c23b63cac admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.276490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.278076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.279531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.280757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.281111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 899/1793] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:11.281923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.282708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.282911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.283232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.286414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.312852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:11.314364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:11.325960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 900/1794] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:11.333586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.338417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 895/1795] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:11.349899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a144-61b2-491c-a48b-2e2a986344ad None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.351179 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.353624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:11.363567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.365294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.365570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.366015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.371769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:11.371769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.372042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa17d-1f43-4515-9a23-a5ec5f1efc42 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.376470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.376619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.377376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.377902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.378350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.379168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.380955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.392455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 896/1796] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:11.397802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.411296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 901/1797] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:11.416040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.418125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbdfd-5015-4f8a-8124-9ec21710750f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.443784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.445034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.445615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.448312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] PATH_INFO: `/v3/projects/a2b76a3bed9b4cb28e233fb03db283df/users/aa054df4f3704b6da99cbb46ad1e989a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.451183 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89015-5695-490b-8cf3-af18a6294134 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.471292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.471844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.472119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.472385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.473018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.474982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.501842 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b76a3bed9b4cb28e233fb03db283df, user_id=aa054df4f3704b6da99cbb46ad1e989a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.504878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.525793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 897/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:11 2022] PUT /identity/v3/projects/a2b76a3bed9b4cb28e233fb03db283df/users/aa054df4f3704b6da99cbb46ad1e989a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:11.530799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.533781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 902/1799] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:11.535799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.595183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:11.602727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9d8f-b182-4ad4-9b6e-206af836bdf8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.608510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.609130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.609510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.609686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.610309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.610466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029f9c-7861-4740-ba4e-2fc54e94b85f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.614418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.621886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.622507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.622968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.623357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.623904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.625598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.638106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 898/1800] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:11.638823 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 903/1801] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:11.643347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.643761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.655290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee049-5450-4d2b-b1ab-c45f47b9f784 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.659361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be559d-37bc-454b-af57-9212d76dce5d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.660659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1354de-c3a9-4e70-a5d9-d4bc940c8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.661498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1354de-c3a9-4e70-a5d9-d4bc940c8ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.661828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1354de-c3a9-4e70-a5d9-d4bc940c8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.662081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1354de-c3a9-4e70-a5d9-d4bc940c8ffc admin admin] PATH_INFO: `/v3/projects/a2b76a3bed9b4cb28e233fb03db283df/users/aa054df4f3704b6da99cbb46ad1e989a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.664047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1354de-c3a9-4e70-a5d9-d4bc940c8ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b76a3bed9b4cb28e233fb03db283df, user_id=aa054df4f3704b6da99cbb46ad1e989a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.664436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.665043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.665317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.665586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.666284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.666896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1354de-c3a9-4e70-a5d9-d4bc940c8ffc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.667862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.682574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 904/1803] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:11.682785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 899/1803] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:11 2022] PUT /identity/v3/projects/a2b76a3bed9b4cb28e233fb03db283df/users/aa054df4f3704b6da99cbb46ad1e989a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:11.686872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.691256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.691542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.691845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.709290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f3c2-16fb-48f9-b6a5-406ef40e6009 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.734530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] MFA Rules not processed for user `aa054df4f3704b6da99cbb46ad1e989a`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:11.736099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:11.854083 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.854731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.855013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.855287 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.855960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.859503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.875765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 900/1804] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:11.887272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 905/1805] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:11.891205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.891332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:11.892594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:11.903389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de295-a1fc-44c0-871b-083cabb06dec admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:11.918911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf6dc-3720-4bab-9010-0ca086117126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:11.919583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf6dc-3720-4bab-9010-0ca086117126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.919860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf6dc-3720-4bab-9010-0ca086117126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.920157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf6dc-3720-4bab-9010-0ca086117126 admin admin] PATH_INFO: `/v3/projects/4a7b3424829d41fdb7d6ccd1f0934684/users/33fd4da492b949c79a25befc4abc74be/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.940138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf6dc-3720-4bab-9010-0ca086117126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7b3424829d41fdb7d6ccd1f0934684, user_id=33fd4da492b949c79a25befc4abc74be, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:11.943770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf6dc-3720-4bab-9010-0ca086117126 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:11.955157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:11.964974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 906/1806] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:11 2022] PUT /identity/v3/projects/4a7b3424829d41fdb7d6ccd1f0934684/users/33fd4da492b949c79a25befc4abc74be/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:11.978029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:11.978639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:11.978639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:11.982244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c2d5c-0221-4373-9758-80489e0abce1 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.019031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] MFA Rules not processed for user `33fd4da492b949c79a25befc4abc74be`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:12.020109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.042346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.043106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.043443 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.043929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.076738 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:12.104436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 907/1807] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:12.109230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.122069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.123573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.134102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 901/1808] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:12.189413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.212252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b4fc2-eab9-4e6a-b33c-19791da67bea None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.218544 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.219106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.221167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.222081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.223465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.225982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.259794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 908/1809] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:12 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:12.264529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.283159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bddd64-2a66-4c9b-a11b-eedaccd9ea98 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.349445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a39c-326c-4954-a089-dd30bbea441c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.355208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.355828 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.356096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.356370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.357014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.358965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.366711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.367257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.367923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.367923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] PATH_INFO: `/v3/users/b92eec6d42da4b37932ee1603f06f30b` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.369220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92eec6d42da4b37932ee1603f06f30b)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.371606 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.387391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 909/1810] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:12 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:12.391235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.398084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:12.407461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680749-24b1-420a-b1da-587946a2acfe admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.412599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.414165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.414522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.414869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.415582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.417322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.429771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 910/1811] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:12.434104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.437932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92eec6d42da4b37932ee1603f06f30b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:12.444323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670c84-3fb1-4b2e-b636-b1ae850a2cc8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.445550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92eec6d42da4b37932ee1603f06f30b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:12.446249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92eec6d42da4b37932ee1603f06f30b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:12.449925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.456650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.456992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.457268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] PATH_INFO: `/v3/projects/bd3339a1c5d446b290b5dfa5f70d9f76/users/4e684bab2d064ed9beb17d117fa22fdb/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.459562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92eec6d42da4b37932ee1603f06f30b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:12.461484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a85b21a-0a20-4190-b676-2ad343742caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92eec6d42da4b37932ee1603f06f30b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:12.467609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:12.477467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3339a1c5d446b290b5dfa5f70d9f76, user_id=4e684bab2d064ed9beb17d117fa22fdb, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.480306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.484169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 902/1812] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:12 2022] DELETE /identity/v3/users/b92eec6d42da4b37932ee1603f06f30b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:12.488935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.489182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.489791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.494432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 911/1813] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:12 2022] PUT /identity/v3/projects/bd3339a1c5d446b290b5dfa5f70d9f76/users/4e684bab2d064ed9beb17d117fa22fdb/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:12.498353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.499940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.517851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:12.519210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.581126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0101-f768-4900-9b4e-9c3c0b5ae67a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.586244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.586858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.587138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.587409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.588042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.589659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.600160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 912/1814] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:12.604997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.607383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 903/1815] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:12.618325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.618895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268366d2-2b7f-46b7-837f-690b6cb4829f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.619840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.623518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219ee5-31a5-40f5-9297-906111892b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.624180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219ee5-31a5-40f5-9297-906111892b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.624457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219ee5-31a5-40f5-9297-906111892b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.625030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219ee5-31a5-40f5-9297-906111892b94 admin admin] PATH_INFO: `/v3/projects/bd3339a1c5d446b290b5dfa5f70d9f76/users/4e684bab2d064ed9beb17d117fa22fdb/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.627487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219ee5-31a5-40f5-9297-906111892b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3339a1c5d446b290b5dfa5f70d9f76, user_id=4e684bab2d064ed9beb17d117fa22fdb, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.630191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219ee5-31a5-40f5-9297-906111892b94 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.644902 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 913/1816] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:12 2022] PUT /identity/v3/projects/bd3339a1c5d446b290b5dfa5f70d9f76/users/4e684bab2d064ed9beb17d117fa22fdb/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:12.656617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.657966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.658246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.700609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] MFA Rules not processed for user `4e684bab2d064ed9beb17d117fa22fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:12.701846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.707948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef82a1-6b79-46fb-8a4b-28d3066f225a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.758594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.759117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.759390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.759658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.786206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 914/1817] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:12.796956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.798407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.820641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:12.825787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.828169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.839425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:12.840311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 904/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:12.860708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c7270-3c91-429f-9c6f-7d569abe43d0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.864770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f3730-d0ee-45f1-8139-29e412631a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.865413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f3730-d0ee-45f1-8139-29e412631a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.865689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f3730-d0ee-45f1-8139-29e412631a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.866706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f3730-d0ee-45f1-8139-29e412631a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.877305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f3730-d0ee-45f1-8139-29e412631a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.881841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f3730-d0ee-45f1-8139-29e412631a83 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.882027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:12.884033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:12.892814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 915/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:12.898852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f2d-3c78-4616-88e8-f0bd8f85d516 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:12.905324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:12.906130 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:12.906555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:12.906917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] PATH_INFO: `/v3/users/28a19a34d6c54b699b9764c9d707dc79` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:12.908541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a19a34d6c54b699b9764c9d707dc79)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:12.911203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:12.995946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a19a34d6c54b699b9764c9d707dc79'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.011816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a19a34d6c54b699b9764c9d707dc79'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.013063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a19a34d6c54b699b9764c9d707dc79'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.031157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a19a34d6c54b699b9764c9d707dc79'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.033157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a19a34d6c54b699b9764c9d707dc79'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.062082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 905/1820] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:12 2022] DELETE /identity/v3/users/28a19a34d6c54b699b9764c9d707dc79 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:13.063832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:13.064294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:13.064371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:13.107314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:13.110076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:13.250297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 916/1821] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:13.254121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:13.255696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:13.316543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:13.318035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:13.341846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1af5d-38e4-4069-ba1b-ee53386d80c2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:13.354526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:13.355195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:13.355476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:13.355742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] PATH_INFO: `/v3/projects/9db153b3841240039660f69946aecef4` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:13.357018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db153b3841240039660f69946aecef4)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:13.359159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:13.447673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd25e5-648c-4176-a64a-ff3e69738d72 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:13.460578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db153b3841240039660f69946aecef4', 'request_id': 'req-f3500152-a233-4140-9355-2ec66a2b2a7a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.472536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db153b3841240039660f69946aecef4', 'request_id': 'req-f3500152-a233-4140-9355-2ec66a2b2a7a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.486080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db153b3841240039660f69946aecef4', 'request_id': 'req-f3500152-a233-4140-9355-2ec66a2b2a7a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.504516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] The token cache is being invalidate because project 9db153b3841240039660f69946aecef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:13.505098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.506101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.509786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 917/1822] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:13 2022] DELETE /identity/v3/projects/9db153b3841240039660f69946aecef4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:13.514342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:13.519255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:13.560700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:13.561339 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:13.561620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:13.561929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:13.567344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:13.660733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:13.681836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3500152-a233-4140-9355-2ec66a2b2a7a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:13.690572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:13.691348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:13.691723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:13.692189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] PATH_INFO: `/v3/users/aa054df4f3704b6da99cbb46ad1e989a` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:13.693555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa054df4f3704b6da99cbb46ad1e989a)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:13.696672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:13.703788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:13.707733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:13.710379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:13.728140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 906/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:13.797561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa054df4f3704b6da99cbb46ad1e989a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.799459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa054df4f3704b6da99cbb46ad1e989a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.827093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa054df4f3704b6da99cbb46ad1e989a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.828213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa054df4f3704b6da99cbb46ad1e989a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.854594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f5298d7e-077a-47ec-9a71-c02250bb891c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa054df4f3704b6da99cbb46ad1e989a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:13.868213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:13.868213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:13.887752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 918/1824] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:13 2022] DELETE /identity/v3/users/aa054df4f3704b6da99cbb46ad1e989a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:13.889036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390536-d1f1-4b00-9928-d9a695f1b33d service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:13.974513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:13.976134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:13.976877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:13.977214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] PATH_INFO: `/v3/users/33fd4da492b949c79a25befc4abc74be` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:13.978444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fd4da492b949c79a25befc4abc74be)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:13.980695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.059873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fd4da492b949c79a25befc4abc74be'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.077873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fd4da492b949c79a25befc4abc74be'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.078616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fd4da492b949c79a25befc4abc74be'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.088801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fd4da492b949c79a25befc4abc74be'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.089466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fd4da492b949c79a25befc4abc74be'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.118308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 907/1825] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:13 2022] DELETE /identity/v3/users/33fd4da492b949c79a25befc4abc74be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:14.124418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.124974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.125078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.147507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:14.149422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.184328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.186734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.224779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 919/1826] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:14.237510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.239651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.256407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:14.275389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96880-05ab-424f-a62f-4fa82bb183cd admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.282674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.283240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.283517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.283791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] PATH_INFO: `/v3/projects/eede50f59cf041d19edde7c4ac1ff1b8` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.285316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eede50f59cf041d19edde7c4ac1ff1b8)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.287261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.334039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81d90e-bdbe-4258-b96a-e0cb45fa5d67 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.352794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eede50f59cf041d19edde7c4ac1ff1b8', 'request_id': 'req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.363040 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eede50f59cf041d19edde7c4ac1ff1b8', 'request_id': 'req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.374287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eede50f59cf041d19edde7c4ac1ff1b8', 'request_id': 'req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.383597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:14.388844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] The token cache is being invalidate because project eede50f59cf041d19edde7c4ac1ff1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:14.389210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.392458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.392458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 908/1827] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:14 2022] DELETE /identity/v3/projects/eede50f59cf041d19edde7c4ac1ff1b8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:14.393131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.395075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.411282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.412008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.412359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.412725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.415155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.470435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16ef73-effb-4dc5-b775-79c0ae9d8dcb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.475889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.476607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.477039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.477314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] PATH_INFO: `/v3/projects/a2b76a3bed9b4cb28e233fb03db283df` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.481043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b76a3bed9b4cb28e233fb03db283df)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.483125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.494583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.496695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ed92b-9d33-4b6d-8988-d2203613f698 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.509028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 920/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:14.513887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979b491-8eb5-4c75-b7f1-394401924220 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.514168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979b491-8eb5-4c75-b7f1-394401924220 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.514446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979b491-8eb5-4c75-b7f1-394401924220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.535098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c979b491-8eb5-4c75-b7f1-394401924220 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:14.536534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c979b491-8eb5-4c75-b7f1-394401924220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.557503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b76a3bed9b4cb28e233fb03db283df', 'request_id': 'req-01022757-4555-4e1e-811d-abf87c87ac6c'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.566009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b76a3bed9b4cb28e233fb03db283df', 'request_id': 'req-01022757-4555-4e1e-811d-abf87c87ac6c'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.579505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b76a3bed9b4cb28e233fb03db283df', 'request_id': 'req-01022757-4555-4e1e-811d-abf87c87ac6c'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.593027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] The token cache is being invalidate because project a2b76a3bed9b4cb28e233fb03db283df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:14.593309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.594268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-01022757-4555-4e1e-811d-abf87c87ac6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:14.596263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 909/1829] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:14 2022] DELETE /identity/v3/projects/a2b76a3bed9b4cb28e233fb03db283df => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:14.601511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788b0b-26fd-4795-8f10-a8e3ae2128fc None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.602085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788b0b-26fd-4795-8f10-a8e3ae2128fc None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.602426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788b0b-26fd-4795-8f10-a8e3ae2128fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.618643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 921/1830] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:14.626450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.626930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.627358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.628073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-09788b0b-26fd-4795-8f10-a8e3ae2128fc None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:14.629586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-09788b0b-26fd-4795-8f10-a8e3ae2128fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.642819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 910/1831] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:14.652274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.653177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.653659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.655982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:14.657205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.667773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:14.670782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 922/1832] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:14.674839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.688093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:14.690677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c6409-4ded-4539-8d90-ef9cbc57fa63 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.691535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.699363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.699984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.700260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.700528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.701174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:14.701472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.703103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.707954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 911/1833] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:14.708861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.732391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04233f04-84d7-4f2e-8217-488a0ed30332 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.733044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 923/1834] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:03:14.733931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.739182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.739945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.740361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.740690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.742036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:14.742402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.744198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.745121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ea3c2-e5ce-4893-a725-fe572e59f7f0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.749962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.750788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.751146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.751483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.752198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.754200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.762259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 912/1835] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:14.766439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.776384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45917-b979-4233-959a-136f3d690e38 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.781769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.782434 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.782724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.783018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.783658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.785660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.792715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 924/1836] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:14.796633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.820086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 913/1837] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:14.824130 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.888620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:14.905785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2ea9f-62bb-46cf-9a89-9712da93de0e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.916370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9c08c-07c3-43b5-af31-3c5a196a5971 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.921177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.921925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.922393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.922715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.923784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.926194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:14.956499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 914/1838] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:14.957806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:14.961065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:14.974454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6ea8b-1ea2-42aa-bb48-55677cfc9e67 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:14.982326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:14.983093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:14.983384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:14.983667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] PATH_INFO: `/v3/projects/4a7b3424829d41fdb7d6ccd1f0934684` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:14.984828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7b3424829d41fdb7d6ccd1f0934684)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:14.986858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.015743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.016373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.016651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.016922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.017768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.019527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.063876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 925/1839] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:14 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:15.064820 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.065167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7b3424829d41fdb7d6ccd1f0934684', 'request_id': 'req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.073914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7b3424829d41fdb7d6ccd1f0934684', 'request_id': 'req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.076848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431f3b-4f00-4294-8b4a-77bb274494d6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.090070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7b3424829d41fdb7d6ccd1f0934684', 'request_id': 'req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.102916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] The token cache is being invalidate because project 4a7b3424829d41fdb7d6ccd1f0934684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:15.103447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.104304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.106084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 915/1840] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:14 2022] DELETE /identity/v3/projects/4a7b3424829d41fdb7d6ccd1f0934684 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:15.107003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.108637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.155083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:15.197526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.198321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.198564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.198811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.199455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.200000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae93fd6-d03e-4478-ae8f-a6651e70b93f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.201253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.204938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.205580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.205938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.206214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.206858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.208457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.212470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 926/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:15.213285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.215033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.224375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 916/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:15.225527 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.228485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.231502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a07e9f-49eb-4805-84ce-cade9a05f423 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.236392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.236731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.237005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.237276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] PATH_INFO: `/v3/users/4e684bab2d064ed9beb17d117fa22fdb` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.238673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e684bab2d064ed9beb17d117fa22fdb)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.241660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.243721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be6767-f1f3-403c-bd3f-7de3486d5111 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.249413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.250101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.250454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.253869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.253869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.253869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.269836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 917/1843] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:15.269836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.279599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94821e5-a756-4a06-b83f-7e64ed03284a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.284832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.285438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.285953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.286087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.286694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.289200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.298364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e684bab2d064ed9beb17d117fa22fdb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.299209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e684bab2d064ed9beb17d117fa22fdb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.301843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 918/1844] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:15.302651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.311927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e684bab2d064ed9beb17d117fa22fdb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.312630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e684bab2d064ed9beb17d117fa22fdb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.314776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7745009-0d09-43a6-9309-3f7f964db687 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.320671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6469f-bb61-4729-8769-d99e3d0f8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.321417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6469f-bb61-4729-8769-d99e3d0f8d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.321836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6469f-bb61-4729-8769-d99e3d0f8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.321977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e684bab2d064ed9beb17d117fa22fdb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:15.322080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6469f-bb61-4729-8769-d99e3d0f8d69 admin admin] PATH_INFO: `/v3/projects/5d37a632ed7b450ca1c923272c3ca36a/users/3cb10317671a45f5ace26c086a6bad06/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.332292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:15.340499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6469f-bb61-4729-8769-d99e3d0f8d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d37a632ed7b450ca1c923272c3ca36a, user_id=3cb10317671a45f5ace26c086a6bad06, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.343474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6469f-bb61-4729-8769-d99e3d0f8d69 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.351369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 927/1845] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:15 2022] DELETE /identity/v3/users/4e684bab2d064ed9beb17d117fa22fdb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:15.353376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.354817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.373825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 919/1846] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:15 2022] PUT /identity/v3/projects/5d37a632ed7b450ca1c923272c3ca36a/users/3cb10317671a45f5ace26c086a6bad06/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:15.383278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.383593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.383824 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.423423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] MFA Rules not processed for user `3cb10317671a45f5ace26c086a6bad06`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:15.425621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.458873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8def41-6e9a-43b0-91ca-ca767608952b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.509225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 920/1847] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:15.523167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.525662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.539496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844b182-e5a5-46fb-b391-10f3e021e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.540188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844b182-e5a5-46fb-b391-10f3e021e24b admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.540498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844b182-e5a5-46fb-b391-10f3e021e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.540785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844b182-e5a5-46fb-b391-10f3e021e24b admin admin] PATH_INFO: `/v3/projects/ed7c2fe2e4b54a059d845b734211d37f/users/0a8d24248d2a443686687bcc264f7761/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.582650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844b182-e5a5-46fb-b391-10f3e021e24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7c2fe2e4b54a059d845b734211d37f, user_id=0a8d24248d2a443686687bcc264f7761, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.585734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844b182-e5a5-46fb-b391-10f3e021e24b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.620601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 928/1848] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:15 2022] PUT /identity/v3/projects/ed7c2fe2e4b54a059d845b734211d37f/users/0a8d24248d2a443686687bcc264f7761/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:15.636076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.636076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.636076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.675096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf085b-164f-4f7b-bf85-9115e6067570 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.691703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] MFA Rules not processed for user `0a8d24248d2a443686687bcc264f7761`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:15.693370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.722402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:15.798336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.799298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.799747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.800920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.845125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 929/1849] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:15.846464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.847961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:15.867832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:15.876148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.878126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.888799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 921/1850] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:15.900294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:15.937532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6fb77-8836-4aac-ba8e-5e3fe6aad546 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.943570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.944684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.945059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.945425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] PATH_INFO: `/v3/projects/bd3339a1c5d446b290b5dfa5f70d9f76` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.946959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3339a1c5d446b290b5dfa5f70d9f76)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.949312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:15.974956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8edd2-ba06-41a6-b13e-71c2326c454d service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:15.988073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:15.988691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:15.989095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:15.989374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:15.990044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:15.992971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.015522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3339a1c5d446b290b5dfa5f70d9f76', 'request_id': 'req-531269ce-cf0f-4862-9023-e4f3dc58044f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.026078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 922/1851] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:15 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:16.027164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3339a1c5d446b290b5dfa5f70d9f76', 'request_id': 'req-531269ce-cf0f-4862-9023-e4f3dc58044f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.030635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.033518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.036034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3339a1c5d446b290b5dfa5f70d9f76', 'request_id': 'req-531269ce-cf0f-4862-9023-e4f3dc58044f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.049907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] The token cache is being invalidate because project bd3339a1c5d446b290b5dfa5f70d9f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:16.050695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.052030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.055126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 930/1852] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:15 2022] DELETE /identity/v3/projects/bd3339a1c5d446b290b5dfa5f70d9f76 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:16.056175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.059758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.118223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddfb3b-316a-4509-b4af-412bdf548fac admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.130105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.131051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.131338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.131644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] PATH_INFO: `/v3/users/3cb10317671a45f5ace26c086a6bad06` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.132957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb10317671a45f5ace26c086a6bad06)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.134905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.152164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:16.156383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531269ce-cf0f-4862-9023-e4f3dc58044f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.162690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bc6f-959f-4485-88e1-58a33533ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.163926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bc6f-959f-4485-88e1-58a33533ea6b admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.164210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bc6f-959f-4485-88e1-58a33533ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.164467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bc6f-959f-4485-88e1-58a33533ea6b admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.165176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bc6f-959f-4485-88e1-58a33533ea6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.167430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bc6f-959f-4485-88e1-58a33533ea6b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.191555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 931/1853] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:16.193110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.193421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.193760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.197449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb10317671a45f5ace26c086a6bad06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.206380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb10317671a45f5ace26c086a6bad06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.208850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb10317671a45f5ace26c086a6bad06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.218282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:16.219557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.220890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb10317671a45f5ace26c086a6bad06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.222415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-58c5827a-58e4-4643-8c9b-0346cf7d540f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb10317671a45f5ace26c086a6bad06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:16.231386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 932/1854] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:16.234617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.237837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.254836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 923/1855] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:16 2022] DELETE /identity/v3/users/3cb10317671a45f5ace26c086a6bad06 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:16.254836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.254836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.254836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.255464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b840a-5bc4-43fe-9c13-c36950c7958f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.281971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:16.294410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:16.296116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.324849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86326554-13ad-48a2-b5f9-9607bfd9b04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.325466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326554-13ad-48a2-b5f9-9607bfd9b04a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.325772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326554-13ad-48a2-b5f9-9607bfd9b04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.326036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326554-13ad-48a2-b5f9-9607bfd9b04a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.326678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86326554-13ad-48a2-b5f9-9607bfd9b04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.328273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86326554-13ad-48a2-b5f9-9607bfd9b04a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.339596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 933/1856] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:16.344368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.344584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.344853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.367041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:16.368372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.377211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 934/1857] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:16.378107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.385389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 924/1858] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:16.391305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.394437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f2ab-5d1d-4d54-8440-44c7c52a344e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.399921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.401254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.401545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.401849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] PATH_INFO: `/v3/projects/7b94299449504eccae444c645e3e05c3/users/b576b8f1ba16433589e41b4d1a22403d/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.406607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677ddca-e287-4112-bcbf-af0070433348 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.411612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.412343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.413430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.413970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.415871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:16.416255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.419266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b94299449504eccae444c645e3e05c3, user_id=b576b8f1ba16433589e41b4d1a22403d, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.419428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.422448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.435915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 935/1859] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:16 2022] PUT /identity/v3/projects/7b94299449504eccae444c645e3e05c3/users/b576b8f1ba16433589e41b4d1a22403d/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:16.436758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.438889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.449123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 925/1860] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:16.449123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.456879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc4714-a20a-41ca-a778-b8d8c93252ae admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.509545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4173a9-9b4b-4f44-9216-21f4a6b2984a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.515155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.516006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.516821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.517104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.528575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.529468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.529766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.530058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.531143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.533180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.548768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 926/1861] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:16.549516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.562487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaca667-f6ee-4b82-8136-a429edc68a70 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.570175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.571446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.571829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.572200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.572936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.576021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.589343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:16.617065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 927/1862] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:16.620565 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.624356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.626333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.641455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 936/1863] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:16.642549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.653251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb553d-a6ec-4e00-a861-542fcbf2228d service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.726592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:16.754925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c88d6f-8e24-4b7e-a4e8-464493474876 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:16.762423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742be12b-1b64-4489-9c5a-837474823844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.763261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742be12b-1b64-4489-9c5a-837474823844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.763544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742be12b-1b64-4489-9c5a-837474823844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.763961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742be12b-1b64-4489-9c5a-837474823844 admin admin] PATH_INFO: `/v3/projects/7b94299449504eccae444c645e3e05c3/users/b576b8f1ba16433589e41b4d1a22403d/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.766532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742be12b-1b64-4489-9c5a-837474823844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b94299449504eccae444c645e3e05c3, user_id=b576b8f1ba16433589e41b4d1a22403d, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.769798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742be12b-1b64-4489-9c5a-837474823844 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.773727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:16.774515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.775262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.775708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.777686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:16.781546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:16.782732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 928/1864] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:16 2022] PUT /identity/v3/projects/7b94299449504eccae444c645e3e05c3/users/b576b8f1ba16433589e41b4d1a22403d/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:16.795798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:16.796194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:16.796996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:16.839938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] MFA Rules not processed for user `b576b8f1ba16433589e41b4d1a22403d`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:16.839938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:16.840605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 937/1865] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/users => generated 281 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:16.841582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:16.865696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc9d6-0b02-49e3-8f5e-545562b64401 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:17.035708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:17.037493 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.039080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.039463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.042084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:17.045398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:17.050779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 929/1866] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:17.063213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 938/1867] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:17.066831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:17.080129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:17.083028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8c3e1-0e70-4f12-8ab5-7aba03b99b4f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:17.083709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.106167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:17.106948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.107323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.108125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.109283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:17.111257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:17.126216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 930/1868] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:17.126216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:17.126216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.140248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549242c-d09a-489b-8702-16de82ab24a0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:17.146296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:17.147115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.147798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.147798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] PATH_INFO: `/v3/projects/5d37a632ed7b450ca1c923272c3ca36a` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.149088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d37a632ed7b450ca1c923272c3ca36a)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:17.151142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:17.251015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e826-5c76-4a18-8f81-5018b85f6537 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:17.260406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d37a632ed7b450ca1c923272c3ca36a', 'request_id': 'req-c558372c-8b2b-4a4d-896a-0a389f0a8162'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:17.281143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d37a632ed7b450ca1c923272c3ca36a', 'request_id': 'req-c558372c-8b2b-4a4d-896a-0a389f0a8162'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:17.286895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:17.300511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d37a632ed7b450ca1c923272c3ca36a', 'request_id': 'req-c558372c-8b2b-4a4d-896a-0a389f0a8162'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:17.327632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] The token cache is being invalidate because project 5d37a632ed7b450ca1c923272c3ca36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:17.329015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:17.331272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:17.334388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 931/1869] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:17 2022] DELETE /identity/v3/projects/5d37a632ed7b450ca1c923272c3ca36a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:17.340322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:17.344164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.373917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:17.374887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.375517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.375934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.380695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.458659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558372c-8b2b-4a4d-896a-0a389f0a8162 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:17.473202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945f5e-7c27-4379-80d5-f6fea31a5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:17.474871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945f5e-7c27-4379-80d5-f6fea31a5b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.475226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945f5e-7c27-4379-80d5-f6fea31a5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.475739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945f5e-7c27-4379-80d5-f6fea31a5b3f admin admin] PATH_INFO: `/v3/projects/82514d63f9b74434b85c232b45affeea/users/0874dc40f6f743928d52df3c41143c06/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.480193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:17.517266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945f5e-7c27-4379-80d5-f6fea31a5b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82514d63f9b74434b85c232b45affeea, user_id=0874dc40f6f743928d52df3c41143c06, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:17.525056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945f5e-7c27-4379-80d5-f6fea31a5b3f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:17.540742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:17.545098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff895eb-0897-4f5e-a5cc-1a9f0ce42839 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:17.557648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 939/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:17.559088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbb3e-92d5-477e-bb68-8d1ed62c411f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.559378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbb3e-92d5-477e-bb68-8d1ed62c411f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.559654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbb3e-92d5-477e-bb68-8d1ed62c411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.561771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 932/1871] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:17 2022] PUT /identity/v3/projects/82514d63f9b74434b85c232b45affeea/users/0874dc40f6f743928d52df3c41143c06/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:17.575691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.576124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.576247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.617695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-909fbb3e-92d5-477e-bb68-8d1ed62c411f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:17.618981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-909fbb3e-92d5-477e-bb68-8d1ed62c411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.651085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] MFA Rules not processed for user `0874dc40f6f743928d52df3c41143c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:17.653569 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.770849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 940/1872] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:17.773549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.774095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.775175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.847460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:17.854898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:17.878286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 933/1873] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:17.894239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 941/1874] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:17.898745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:17.916808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723e36-6261-41f9-8dd4-9e1253e47b26 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:17.928699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:17.930183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:17.930892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:17.931160 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:17.933237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:17.935903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:17.940349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:17.987921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 934/1875] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:17.989688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.014419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edc40-415b-420a-b805-6f6216db08f3 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.030769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.031409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.031690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.031989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.032715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.035006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.113835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 942/1876] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:17 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:18.115755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.122527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.125367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:18.133202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bcf95-550b-4b84-88b7-8c2b89839cb7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.203730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:18.259193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.261415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.261775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.263229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.263983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.267745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.285524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b55d9-1a6e-4990-993a-f7c38304cdf7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.291633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.292265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.292501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.294309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.311813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 935/1877] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:18 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:18.324829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.350579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e289880-d0dc-40f0-bf1f-0be85df07e35 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.356379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.357112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.357464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.358064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.358751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.360708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.390030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 936/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:18.391369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.405643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd924c-6e28-46f8-bd88-179f9b6d7043 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.433213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.433877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.434178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.434492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.435136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.436798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.438085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.439851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.452816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 943/1879] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:18.463398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 937/1880] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:18.474173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.474925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.481526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:18.489984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2f61b-43f0-49e8-b17a-5246bdef94ad service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.490560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa59ef-7748-4c8a-a64a-cfefcf696fff admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.496808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.496951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbbb06-7240-48a4-a67c-038990dbdbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.497468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.498022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.498137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbbb06-7240-48a4-a67c-038990dbdbc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.498479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] PATH_INFO: `/v3/users/0874dc40f6f743928d52df3c41143c06` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.498733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbbb06-7240-48a4-a67c-038990dbdbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.499762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbbb06-7240-48a4-a67c-038990dbdbc7 admin admin] PATH_INFO: `/v3/projects/d0195cc54cac4d27b15e4106c99e12d9/users/4f37208f32294e89a24c1a9a205a3034/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.500751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0874dc40f6f743928d52df3c41143c06)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.504326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.520675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbbb06-7240-48a4-a67c-038990dbdbc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0195cc54cac4d27b15e4106c99e12d9, user_id=4f37208f32294e89a24c1a9a205a3034, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.525866 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbbb06-7240-48a4-a67c-038990dbdbc7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.561856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 944/1881] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:18 2022] PUT /identity/v3/projects/d0195cc54cac4d27b15e4106c99e12d9/users/4f37208f32294e89a24c1a9a205a3034/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:18.563917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.564374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.564960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.578114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0874dc40f6f743928d52df3c41143c06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:18.588748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0874dc40f6f743928d52df3c41143c06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:18.589855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0874dc40f6f743928d52df3c41143c06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:18.603794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0874dc40f6f743928d52df3c41143c06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:18.604719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ecbdbce6-c7bb-4773-bd4c-5158d582b6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0874dc40f6f743928d52df3c41143c06'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:18.608570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] MFA Rules not processed for user `4f37208f32294e89a24c1a9a205a3034`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:18.610080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:18.631084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 938/1882] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:18 2022] DELETE /identity/v3/users/0874dc40f6f743928d52df3c41143c06 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:18.637887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.638097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.639293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.665099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:18.667212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:18.734089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 945/1883] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:18.746620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.748072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:18.777308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 939/1884] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:18.790531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:18.792414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:18.823581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:18.837261 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be65ab-beb0-479d-9a85-93fbbaabcc67 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.860802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb1b11-5dbf-45a5-8f16-8d4253f4c412 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:18.864506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.865121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.865398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.865701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.876259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:18.878126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:18.889086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 940/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:18.930450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34646514-2e16-437e-9edd-562f6359d442 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:18.931301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34646514-2e16-437e-9edd-562f6359d442 service glance] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:18.931527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34646514-2e16-437e-9edd-562f6359d442 service glance] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:18.931799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34646514-2e16-437e-9edd-562f6359d442 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:18.990211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:19.025165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34646514-2e16-437e-9edd-562f6359d442 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:19.026075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34646514-2e16-437e-9edd-562f6359d442 service glance] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:19.039993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 946/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:19.583468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:19.588340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:19.608474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4db7c-eb36-471e-8594-4cc6f5437de2 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:19.649036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:19.650660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:19.652388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:19.653067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] PATH_INFO: `/v3/projects/82514d63f9b74434b85c232b45affeea` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:19.660325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82514d63f9b74434b85c232b45affeea)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:19.669480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:19.766031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82514d63f9b74434b85c232b45affeea', 'request_id': 'req-404c4bae-bcc1-43b3-9d02-e39b67873679'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:19.779643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82514d63f9b74434b85c232b45affeea', 'request_id': 'req-404c4bae-bcc1-43b3-9d02-e39b67873679'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:19.794514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82514d63f9b74434b85c232b45affeea', 'request_id': 'req-404c4bae-bcc1-43b3-9d02-e39b67873679'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:19.816901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] The token cache is being invalidate because project 82514d63f9b74434b85c232b45affeea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:19.817451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:19.818307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-404c4bae-bcc1-43b3-9d02-e39b67873679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:19.821573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 941/1887] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:19 2022] DELETE /identity/v3/projects/82514d63f9b74434b85c232b45affeea => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:19.826442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:19.827040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:19.827190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:19.866985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:19.868499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:20.012324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 947/1888] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:20.019677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.019963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.020244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.051839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:20.052976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:20.064355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 942/1889] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:20.068585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.083142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe64b4-58eb-4916-8304-f789739dfa92 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.108168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.108802 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.109084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.109360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.110080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:20.118020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.118020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.118501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.118501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:20.154125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 948/1890] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:20.155062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.173515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb816f-481c-4e6a-9213-4e7ac94bd7fa admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.188771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.189407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.189961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.190274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.190976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.207125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.283653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f7e78-fff3-4eed-8807-f7ba9e7a7281 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.287743 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 949/1891] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:20 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:20.294998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.299526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.300403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.300764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.301110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.303969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:20.398915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:20.414195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.417682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.430284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19f73-8534-4c32-a3c4-842bfe97865c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.436033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.436799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.437088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.437362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.438825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.440950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.441858 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 943/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:20.480142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 950/1893] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:20 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:20.484374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.497068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58238d79-ef09-44f3-b5e6-db982ae8fd40 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.503781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.504413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.504746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.505031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.505682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.507463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.519597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 944/1894] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:20.524163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.539607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faecfc-acdd-42c0-b94b-b09b9acfb029 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.545352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603de39-c03a-464a-a44c-bad6e126709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.547089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603de39-c03a-464a-a44c-bad6e126709e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.547602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603de39-c03a-464a-a44c-bad6e126709e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.548141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603de39-c03a-464a-a44c-bad6e126709e admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.549707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603de39-c03a-464a-a44c-bad6e126709e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.552019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603de39-c03a-464a-a44c-bad6e126709e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.568127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 951/1895] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:20.573017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.584532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba12d6-7c8c-4a48-a6bc-d30369e3192e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.596277 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.599006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.599521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.601645 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] PATH_INFO: `/v3/projects/fe6c0d4c5bb64992a3235c8b05d9539c/users/10489fe10fcf452295ba7f2a4f1facc0/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.640899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6c0d4c5bb64992a3235c8b05d9539c, user_id=10489fe10fcf452295ba7f2a4f1facc0, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.644545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.697028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.697164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 945/1896] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:20 2022] PUT /identity/v3/projects/fe6c0d4c5bb64992a3235c8b05d9539c/users/10489fe10fcf452295ba7f2a4f1facc0/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:20.697248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.697475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.716100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.720789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:20.779752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] MFA Rules not processed for user `10489fe10fcf452295ba7f2a4f1facc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:20.781143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:20.795753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:20.835121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f9161-70fa-42d1-85d1-2f158bbddf22 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:20.840716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:20.841441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:20.841636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:20.841943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] PATH_INFO: `/v3/users/845b462237c64570a801d2de61ee25de` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:20.843400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=845b462237c64570a801d2de61ee25de)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:20.845002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:20.904868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 952/1897] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:20.916786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845b462237c64570a801d2de61ee25de'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:20.920040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:20.926289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845b462237c64570a801d2de61ee25de'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:20.927012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845b462237c64570a801d2de61ee25de'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:20.939660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845b462237c64570a801d2de61ee25de'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:20.940601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845b462237c64570a801d2de61ee25de'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:20.967848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 946/1898] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:20 2022] DELETE /identity/v3/users/845b462237c64570a801d2de61ee25de => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:21.015567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8ef9-1d2a-4770-9e03-ad89260ae2d5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.077791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.078411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.078692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.078963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.080853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.152377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.152377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.163252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 953/1899] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:21.180206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.181646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.266025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:21.303885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974584ca-dbaa-4b30-9b6e-5551d82f4f7f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.311290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.311939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.312378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.312719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] PATH_INFO: `/v3/projects/7c534d26b960420faac648109bbd61a9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.315512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c534d26b960420faac648109bbd61a9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.324619 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.421317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c534d26b960420faac648109bbd61a9', 'request_id': 'req-b7d65515-143b-4bc4-9794-3e8011e18f9b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.435686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c534d26b960420faac648109bbd61a9', 'request_id': 'req-b7d65515-143b-4bc4-9794-3e8011e18f9b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.436503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.438931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.448230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c534d26b960420faac648109bbd61a9', 'request_id': 'req-b7d65515-143b-4bc4-9794-3e8011e18f9b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.461231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] The token cache is being invalidate because project 7c534d26b960420faac648109bbd61a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:21.461670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.462337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-b7d65515-143b-4bc4-9794-3e8011e18f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.464139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 947/1900] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:21 2022] DELETE /identity/v3/projects/7c534d26b960420faac648109bbd61a9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:21.469152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e01c9-1e08-42a2-bc34-26303f96563a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.469378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e01c9-1e08-42a2-bc34-26303f96563a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.469731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e01c9-1e08-42a2-bc34-26303f96563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.482034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0f3f-4743-4250-a7d7-8d150e6ec74c service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.497603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-309e01c9-1e08-42a2-bc34-26303f96563a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:21.499047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-309e01c9-1e08-42a2-bc34-26303f96563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.502809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:21.566282 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.567326 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.567885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.568167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] PATH_INFO: `/v3/users/0a8d24248d2a443686687bcc264f7761` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.571953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8d24248d2a443686687bcc264f7761)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.574537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.589786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 948/1901] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:21.595003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.596166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.596543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.639103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:21.642281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.652651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8d24248d2a443686687bcc264f7761'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.653210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8d24248d2a443686687bcc264f7761'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.658044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 949/1902] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:21.661124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8d24248d2a443686687bcc264f7761'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.661853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8d24248d2a443686687bcc264f7761'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.663080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.676898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec03c01-b655-49c5-8ffa-9335d5b6f39d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.677575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-204f6426-9d74-4776-b5e2-0e45b74cd44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8d24248d2a443686687bcc264f7761'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:21.683705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.684388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.684670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.685090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.685840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:21.686193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.688433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.702551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 954/1903] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:21 2022] DELETE /identity/v3/users/0a8d24248d2a443686687bcc264f7761 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:21.704663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 950/1904] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:21.706766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.707124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.707513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.709502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.711659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.729342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4d9f9-2cb2-4424-b855-4bec3a7a7ee9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.733364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:21.734645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.779709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:21.794782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.795387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.795661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.795931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.796564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.798511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.799422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 955/1905] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:21.809252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.810634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:21.832535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 951/1906] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:21 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:21.833586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.857583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:21.871150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be44b-c6d1-46fa-acf2-7583f61cd668 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.901135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b2c6-367a-4223-a587-1dfc089b4d6e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.905818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.906425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.906701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.906972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.907595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.909506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.920347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.920956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.921230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.921497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.934602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 952/1907] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:21 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:21.934785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.934785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.935741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.948161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 956/1908] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:21.950111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757dce-eefd-46de-a3fe-79387e605156 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.955401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.956043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.956325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.956597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:21.957240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:21.961137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:21.973915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 953/1909] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:21.977801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:21.991891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598adfac-3313-4417-8adc-d9fb8626a3d3 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:21.997585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9c96e-eabb-4584-9866-4808c11d4787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:21.998749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c96e-eabb-4584-9866-4808c11d4787 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:21.999038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c96e-eabb-4584-9866-4808c11d4787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:21.999329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c96e-eabb-4584-9866-4808c11d4787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:22.000056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9c96e-eabb-4584-9866-4808c11d4787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:22.002317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9c96e-eabb-4584-9866-4808c11d4787 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:22.015400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 957/1910] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:22.019958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:22.033377 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385ffd-f4d0-4714-b2b0-8cc1ffd0e779 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:22.039337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:22.040462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:22.040462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:22.040861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] PATH_INFO: `/v3/projects/6d0dd0315bea442e9e651b6581fd75e2/users/6b53b2fbfb31429387e68f47f2650403/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:22.061518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0dd0315bea442e9e651b6581fd75e2, user_id=6b53b2fbfb31429387e68f47f2650403, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:22.064258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:22.083119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 954/1911] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:22 2022] PUT /identity/v3/projects/6d0dd0315bea442e9e651b6581fd75e2/users/6b53b2fbfb31429387e68f47f2650403/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:22.091012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:22.091329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:22.091637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:22.112102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:22.113307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:22.195081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 958/1912] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:22.205459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:22.207284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:22.269278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:22.271350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:22.285673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d512c-b911-4b16-bca6-b4e148c9a4fe admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:22.290344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:22.291083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:22.291442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:22.291832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:22.292155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dae29f-c287-4489-9d2f-12242be894f9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:22.297036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:22.297664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:22.297973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:22.298248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] PATH_INFO: `/v3/projects/ed7c2fe2e4b54a059d845b734211d37f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:22.299453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7c2fe2e4b54a059d845b734211d37f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:22.301353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:22.302579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:22.305131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:22.314807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 955/1913] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:22.356256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7c2fe2e4b54a059d845b734211d37f', 'request_id': 'req-4a90c3a7-8854-4c60-8114-d911afc5939e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.362864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7c2fe2e4b54a059d845b734211d37f', 'request_id': 'req-4a90c3a7-8854-4c60-8114-d911afc5939e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.371414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7c2fe2e4b54a059d845b734211d37f', 'request_id': 'req-4a90c3a7-8854-4c60-8114-d911afc5939e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.382697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] The token cache is being invalidate because project ed7c2fe2e4b54a059d845b734211d37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:22.382992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.383679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.385439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 959/1914] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:22 2022] DELETE /identity/v3/projects/ed7c2fe2e4b54a059d845b734211d37f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:22.390192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:22.401385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcc93a-bfad-48bf-bd97-e52376a547c4 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:22.432445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:22.469036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:22.469317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:22.469595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:22.469952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] PATH_INFO: `/v3/users/b576b8f1ba16433589e41b4d1a22403d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:22.471186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b576b8f1ba16433589e41b4d1a22403d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:22.473206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:22.549701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b576b8f1ba16433589e41b4d1a22403d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.561764 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b576b8f1ba16433589e41b4d1a22403d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.562638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b576b8f1ba16433589e41b4d1a22403d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.572156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b576b8f1ba16433589e41b4d1a22403d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.573006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3ccda0d2-a5a1-47e1-9c4c-ffd473311eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b576b8f1ba16433589e41b4d1a22403d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:22.596938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 956/1915] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:22 2022] DELETE /identity/v3/users/b576b8f1ba16433589e41b4d1a22403d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:23.252881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:23.255063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:23.275105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90c3a7-8854-4c60-8114-d911afc5939e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:23.287060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:23.404522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:23.405182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:23.405460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:23.405975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] PATH_INFO: `/v3/projects/7b94299449504eccae444c645e3e05c3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:23.407280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b94299449504eccae444c645e3e05c3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:23.409213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:23.472566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b94299449504eccae444c645e3e05c3', 'request_id': 'req-016b8de9-b036-49a0-a271-e71f4c58c12d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:23.482279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b94299449504eccae444c645e3e05c3', 'request_id': 'req-016b8de9-b036-49a0-a271-e71f4c58c12d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:23.496414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b94299449504eccae444c645e3e05c3', 'request_id': 'req-016b8de9-b036-49a0-a271-e71f4c58c12d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:23.510050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] The token cache is being invalidate because project 7b94299449504eccae444c645e3e05c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:23.510346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:23.511015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016b8de9-b036-49a0-a271-e71f4c58c12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:23.512961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 960/1916] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:23 2022] DELETE /identity/v3/projects/7b94299449504eccae444c645e3e05c3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:23.517851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:23.518037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:23.518447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:23.569331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:23.570792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:23.704998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 957/1917] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:23.714541 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:23.714978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:23.715078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:23.738583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:23.739906 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:23.760472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 961/1918] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:23.765323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:23.790384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded94b-7403-44ca-a054-3850fd00c88a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:23.807303 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:23.808293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:23.808753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:23.809201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:23.810135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:23.810623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:23.812605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:23.848272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 958/1919] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:23.849226 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:23.871652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdb230-4d72-4ae9-b4ce-35f5f49eff83 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:23.887990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:23.890484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:23.891561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:23.891856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:23.892650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:23.898962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:23.990340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.014967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 962/1920] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:23 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:24.030116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101760d-de10-46f0-8678-15cc7635fce5 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.121238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:24.171564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.172344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.172511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.172765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.173556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.176964 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.223617 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 959/1921] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:23 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:24.230403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.242900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786164-d881-49c7-9da9-9563a063bbb0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.248013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.248638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.248918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.249189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.250101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.251857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.268232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.274567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 963/1922] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:24.282562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572529da-f6dc-4b85-853a-825f34e3033d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.289207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97a754-756e-4499-bc2a-1c37c340b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.290112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a754-756e-4499-bc2a-1c37c340b91f admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.290587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a754-756e-4499-bc2a-1c37c340b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.291165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a754-756e-4499-bc2a-1c37c340b91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.292193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97a754-756e-4499-bc2a-1c37c340b91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.294299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97a754-756e-4499-bc2a-1c37c340b91f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.314364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 960/1923] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:24.317998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.333639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39f85d-2a3d-4582-92e5-596bf725789d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.341194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.342436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.343014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.343550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] PATH_INFO: `/v3/projects/8f86257f6e8c4dfba109cc777c6273a9/users/31c26249f3ba4a999b3932a929418291/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.369164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86257f6e8c4dfba109cc777c6273a9, user_id=31c26249f3ba4a999b3932a929418291, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.373063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.413730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 964/1924] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:24 2022] PUT /identity/v3/projects/8f86257f6e8c4dfba109cc777c6273a9/users/31c26249f3ba4a999b3932a929418291/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:24.413949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.414344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.414863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.461563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] MFA Rules not processed for user `31c26249f3ba4a999b3932a929418291`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:24.462983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:24.640048 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.651808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 961/1925] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:24.659490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.660354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:24.751326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a437aa6-ab6c-4713-8016-c966fae68754 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.758677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.760321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.760932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.761236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.762304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.763895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:24.766280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.799715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938913ba-bf4f-40f7-94fb-19622e98d9b5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.812410 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.813066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.813841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.814124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] PATH_INFO: `/v3/users/10489fe10fcf452295ba7f2a4f1facc0` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.821625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10489fe10fcf452295ba7f2a4f1facc0)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.823941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 962/1926] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:24 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:24.824870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:24.825512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.888482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:24.918970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10489fe10fcf452295ba7f2a4f1facc0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:24.920143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10489fe10fcf452295ba7f2a4f1facc0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:24.934528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10489fe10fcf452295ba7f2a4f1facc0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:24.935765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910f3b-3d81-4ffc-9ebb-8bffc592fd6c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:24.936136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10489fe10fcf452295ba7f2a4f1facc0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:24.941713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:24.943120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.943120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.943120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:24.946717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:24.950127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8a007012-91d1-460a-a0a3-3e5d2be9f6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10489fe10fcf452295ba7f2a4f1facc0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:24.955467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:24.986264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 965/1927] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:24 2022] DELETE /identity/v3/users/10489fe10fcf452295ba7f2a4f1facc0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:24.988865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:24.991883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:24.992708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.024633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 963/1928] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:24 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:25.025860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.028156 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:25.046062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87bc9b-03b1-45ec-b9fe-35086e7d6f68 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.062357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:25.063584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:25.165937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.166872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.167306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.167757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.168661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.170949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.185882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 964/1929] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:25.190536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.219108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 966/1930] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:25.220208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beac8e-10b4-4a40-8afe-68423699acef admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.228111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.228993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.229119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.229595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.230116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.230674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:25.231501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.233350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.263566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 965/1931] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:25.264718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.283509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85653-a955-41fe-8c49-8e7fd4e5a218 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.289112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a601-702b-4df6-ae5e-d3bd0a0a53e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.289837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a601-702b-4df6-ae5e-d3bd0a0a53e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.290121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a601-702b-4df6-ae5e-d3bd0a0a53e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.290405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a601-702b-4df6-ae5e-d3bd0a0a53e5 admin admin] PATH_INFO: `/v3/projects/e954e14822f341789f6a0fb7c00dee32/users/3c0cbf67eb154314b045da03b7ef65cf/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.320109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a601-702b-4df6-ae5e-d3bd0a0a53e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e954e14822f341789f6a0fb7c00dee32, user_id=3c0cbf67eb154314b045da03b7ef65cf, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.323217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a601-702b-4df6-ae5e-d3bd0a0a53e5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.329203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11aead-d683-4905-b4aa-0093f3ccc709 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.344306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.347953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.348515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.348988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.359371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 966/1932] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:25 2022] PUT /identity/v3/projects/e954e14822f341789f6a0fb7c00dee32/users/3c0cbf67eb154314b045da03b7ef65cf/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:25.361972 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.363419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.370056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.370633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.370900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.379422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 967/1933] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:25.440834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] MFA Rules not processed for user `3c0cbf67eb154314b045da03b7ef65cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:25.446759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:25.546484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 967/1934] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:25.550700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.557298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:25.570880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ce0f3-3814-4f84-aa37-f545ab6ac8f8 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.651423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.652036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.652314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.652583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.653230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.655203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.692622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 968/1935] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:25 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:25.696939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.711142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e78714-a72d-4300-8036-17464e8b7bfb None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.717036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:25.807706 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.808407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.808777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.809116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.810139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.812197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.857337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 968/1936] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:25 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:25.862792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.876097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648efe35-48da-4b8c-adb9-aa655b8b2131 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.884321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.885039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.885496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.886024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:25.887556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:25.889279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:25.924253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 969/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:25.925952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:25.950541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26743f61-ad68-4ca3-8bab-cfc1ec1a684f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:25.970867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:25.974477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:25.976344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:25.980726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] PATH_INFO: `/v3/projects/acb8d5608e2b4ba1b5c64cb24c6a02a1/users/5dde2363d2984f70ab2c15d7134a900e/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.007830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb8d5608e2b4ba1b5c64cb24c6a02a1, user_id=5dde2363d2984f70ab2c15d7134a900e, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.012386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.034121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 969/1938] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:25 2022] PUT /identity/v3/projects/acb8d5608e2b4ba1b5c64cb24c6a02a1/users/5dde2363d2984f70ab2c15d7134a900e/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:26.039160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.057648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aa2f3-b046-4011-82ac-db64167c5151 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.172145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.183441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.183894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.184181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.184920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.192099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.223103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 970/1939] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:26.230537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.231953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.235322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:26.257998 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64198-cb96-46f0-8220-8a4552265dc6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.260049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.260491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437ab2-58f1-47b2-bf49-f42ccdfe441a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.260978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.261262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.261678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] PATH_INFO: `/v3/projects/fe6c0d4c5bb64992a3235c8b05d9539c` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.263335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6c0d4c5bb64992a3235c8b05d9539c)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.265496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.273370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956dfc9-79d7-4d13-a690-2d76a4f04691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.274543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dfc9-79d7-4d13-a690-2d76a4f04691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.275789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dfc9-79d7-4d13-a690-2d76a4f04691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.278137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dfc9-79d7-4d13-a690-2d76a4f04691 admin admin] PATH_INFO: `/v3/projects/acb8d5608e2b4ba1b5c64cb24c6a02a1/users/5dde2363d2984f70ab2c15d7134a900e/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.285679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956dfc9-79d7-4d13-a690-2d76a4f04691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb8d5608e2b4ba1b5c64cb24c6a02a1, user_id=5dde2363d2984f70ab2c15d7134a900e, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.290558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956dfc9-79d7-4d13-a690-2d76a4f04691 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.306437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 971/1940] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:26 2022] PUT /identity/v3/projects/acb8d5608e2b4ba1b5c64cb24c6a02a1/users/5dde2363d2984f70ab2c15d7134a900e/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:26.320641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.321167 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.321867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.357947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] MFA Rules not processed for user `5dde2363d2984f70ab2c15d7134a900e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:26.359946 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:26.390366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6c0d4c5bb64992a3235c8b05d9539c', 'request_id': 'req-9e5bdfe5-2770-4196-b8d7-cf96bb974459'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:26.407909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6c0d4c5bb64992a3235c8b05d9539c', 'request_id': 'req-9e5bdfe5-2770-4196-b8d7-cf96bb974459'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:26.420979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6c0d4c5bb64992a3235c8b05d9539c', 'request_id': 'req-9e5bdfe5-2770-4196-b8d7-cf96bb974459'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:26.446444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] The token cache is being invalidate because project fe6c0d4c5bb64992a3235c8b05d9539c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:26.446812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:26.447985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-9e5bdfe5-2770-4196-b8d7-cf96bb974459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:26.449837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 970/1941] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:26 2022] DELETE /identity/v3/projects/fe6c0d4c5bb64992a3235c8b05d9539c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:26.455815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645556-28f5-4c7c-adfa-05e27dc9ec88 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.456268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645556-28f5-4c7c-adfa-05e27dc9ec88 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.456597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645556-28f5-4c7c-adfa-05e27dc9ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.467631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:26.493066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e3645556-28f5-4c7c-adfa-05e27dc9ec88 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:26.494904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e3645556-28f5-4c7c-adfa-05e27dc9ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:26.500341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 972/1942] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:26.516474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.518031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:26.564702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:26.580554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 971/1943] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:26.588627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.588924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.589212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.612304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe3704-b15a-466f-babd-d9072779f8ad None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.618572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:26.618752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.619483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.620122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.620233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:26.620649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.623787 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:26.630461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 972/1944] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:26.634643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.646431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0fe64-cd5a-4598-93fe-25f3879a0824 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.654531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.655507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.655886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.657831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.657831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:26.657831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.664693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.683871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 973/1945] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:26.696190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.713968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263274e-58b4-45b2-8b19-f7e647c0b7c7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.722184 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.723136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.724637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.725799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.726952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.729655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.760337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.762748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.774913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 973/1946] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:26.801872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 974/1947] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:26 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:26.807372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:26.820239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7753c-95a1-47be-afac-3a5edd8065c6 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:26.953725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:26.954384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:26.954661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:26.954932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:26.955635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:26.957684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:26.998482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 974/1948] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:26 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:27.002499 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:27.030369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3c803-2a66-4cf3-ae54-9529427dd9e0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:27.051770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:27.052677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.053828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.054395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.055708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:27.058816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:27.087078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 975/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:27.089914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:27.109958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf308cd-958e-4ab4-a78e-d9287b1e8889 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:27.119724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4515e-afcf-41e9-9e89-b480b180950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:27.120259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4515e-afcf-41e9-9e89-b480b180950a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.120560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4515e-afcf-41e9-9e89-b480b180950a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.120836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4515e-afcf-41e9-9e89-b480b180950a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.121492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4515e-afcf-41e9-9e89-b480b180950a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:27.123157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4515e-afcf-41e9-9e89-b480b180950a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:27.142565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 975/1950] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:27.146548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:27.161996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b135eb-ced9-412d-9e8c-ee183ade6bc9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:27.174219 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:27.175267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.175749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.176259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] PATH_INFO: `/v3/projects/24030d5e74ca478ea0e99f798d27650e/users/c6180c5c918846bf962cc54e9c92f08e/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.222240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24030d5e74ca478ea0e99f798d27650e, user_id=c6180c5c918846bf962cc54e9c92f08e, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:27.229387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:27.259007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 976/1951] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:27 2022] PUT /identity/v3/projects/24030d5e74ca478ea0e99f798d27650e/users/c6180c5c918846bf962cc54e9c92f08e/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:27.276040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.276441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.276799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.386666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] MFA Rules not processed for user `c6180c5c918846bf962cc54e9c92f08e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:27.396414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:27.423043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:27.580641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 976/1952] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:27.585062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:27.729348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288845-5137-485a-b90f-c5d4a4962e49 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:27.737133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:27.738358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.739051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.739532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.740596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:27.744293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:27.813954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 977/1953] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:27 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:27.819822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:27.838570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc5d1-5b3e-4e10-807e-cc5cca92fa72 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:27.915842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:27.916876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.917363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.917840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.918584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:27.921232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:27.949826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 977/1954] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:27 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:27.951614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:27.975454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19eff9-4f67-4293-b0a6-e05228e78c79 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:27.987248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:27.987956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:27.988364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:27.988647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:27.989301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:27.993632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.017456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 978/1955] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:28.019460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.036426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98046-12d5-44da-a712-699b47cf528e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.043565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5630d-dc35-4e04-9317-e2d3c6cbc80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.044939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5630d-dc35-4e04-9317-e2d3c6cbc80a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.045281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5630d-dc35-4e04-9317-e2d3c6cbc80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.045618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5630d-dc35-4e04-9317-e2d3c6cbc80a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.046358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5630d-dc35-4e04-9317-e2d3c6cbc80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.048026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5630d-dc35-4e04-9317-e2d3c6cbc80a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.059670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 978/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:28.065186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.079685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904374e-40ad-4423-9f21-5349f871fed3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.087140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.087822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.088161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.088437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] PATH_INFO: `/v3/projects/49cda07a59824ba29284f33214d3c212/users/bf941115a35b4a358fa13d18082e01f2/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.113579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cda07a59824ba29284f33214d3c212, user_id=bf941115a35b4a358fa13d18082e01f2, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.117208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.132949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 979/1957] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:28 2022] PUT /identity/v3/projects/49cda07a59824ba29284f33214d3c212/users/bf941115a35b4a358fa13d18082e01f2/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:28.145145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.145432 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.145700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.185341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] MFA Rules not processed for user `bf941115a35b4a358fa13d18082e01f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:28.187061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:28.302501 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 979/1958] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:28.308163 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.406444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:28.468523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b03bf-3cd5-47cf-9253-de4c717453c2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.486247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.487022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.487357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.487915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.488662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.493215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.561774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 980/1959] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:28 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:28.563334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.587106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002dc5c-3736-4c8c-bc6c-bf876cbc9035 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.609380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:28.667052 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.699133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.699897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.700336 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.700703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.701360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.703870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.737990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 980/1960] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:28 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:28.743350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.755712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889d92-42d1-4f15-bae0-f389fd6dbd32 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.775959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.776783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.777184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.777511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.778155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.782666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.792518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bbc3-a173-41f2-a8e9-c8653e2d5571 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.796471 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.797093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.797679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.797990 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.801200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 981/1961] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:28.801491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:28.803001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.823113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a44ec-f8c8-469d-962f-ec85971b92c6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:28.830680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:28.831683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:28.832343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:28.832929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] PATH_INFO: `/v3/projects/65c44cfa9250485b8c7690003cc226e5/users/4ffd2d028d2d45a4b5d91a764a5fba6f/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:28.860186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c44cfa9250485b8c7690003cc226e5, user_id=4ffd2d028d2d45a4b5d91a764a5fba6f, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.863995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.896208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 982/1962] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:28 2022] PUT /identity/v3/projects/65c44cfa9250485b8c7690003cc226e5/users/4ffd2d028d2d45a4b5d91a764a5fba6f/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:28.898640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:28.925554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:28.927464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:28.948922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 981/1963] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:29.034111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fcb34-54ff-4743-9529-add828063d0d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:29.051540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f62ac-842f-4f5a-b9b6-91b896f98029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:29.052123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f62ac-842f-4f5a-b9b6-91b896f98029 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:29.052402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f62ac-842f-4f5a-b9b6-91b896f98029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:29.052671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f62ac-842f-4f5a-b9b6-91b896f98029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:29.054265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f62ac-842f-4f5a-b9b6-91b896f98029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:29.055989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f62ac-842f-4f5a-b9b6-91b896f98029 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:29.085623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 983/1964] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:29.089782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:29.108829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fbd3-1698-472f-85bd-fc88df0e8c58 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:29.116650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:29.117497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:29.117848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:29.118741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] PATH_INFO: `/v3/projects/65c44cfa9250485b8c7690003cc226e5/users/4ffd2d028d2d45a4b5d91a764a5fba6f/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:29.121424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c44cfa9250485b8c7690003cc226e5, user_id=4ffd2d028d2d45a4b5d91a764a5fba6f, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:29.125262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:29.150886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 982/1965] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:29 2022] PUT /identity/v3/projects/65c44cfa9250485b8c7690003cc226e5/users/4ffd2d028d2d45a4b5d91a764a5fba6f/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:29.161575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e68a9-9344-4175-bafa-46031ac095a3 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:29.162029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e68a9-9344-4175-bafa-46031ac095a3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:29.162931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e68a9-9344-4175-bafa-46031ac095a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:29.248025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ba5e68a9-9344-4175-bafa-46031ac095a3 None None] MFA Rules not processed for user `4ffd2d028d2d45a4b5d91a764a5fba6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:29.249291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ba5e68a9-9344-4175-bafa-46031ac095a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:29.373881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:29.411122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 984/1966] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:29.502828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:29.504716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:29.647267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449612c-d898-44f0-9c91-058ded1f1006 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:29.652667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:29.654238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:29.655132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:29.655497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:29.670114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:29.692591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:29.693097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:29.693097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:29.739685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] MFA Rules not processed for user `6b53b2fbfb31429387e68f47f2650403`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:29.741991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:29.775765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:29.777385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:29.790510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 983/1967] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:29.874319 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 985/1968] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:29.891513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:29.893561 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:30.021069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3db3e-5eb5-4a37-97ac-8f24359831d2 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:30.033949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:30.035292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:30.035811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:30.036226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:30.049455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:30.051388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:30.065320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 984/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:30.140147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:30.156974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f4a5-85bf-42ce-85b1-7577f8818448 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:30.168178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bdff7-c939-4e4e-b410-9c52089502f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:30.169468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bdff7-c939-4e4e-b410-9c52089502f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:30.170000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bdff7-c939-4e4e-b410-9c52089502f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:30.170913 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bdff7-c939-4e4e-b410-9c52089502f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:30.293113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bdff7-c939-4e4e-b410-9c52089502f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:30.295518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bdff7-c939-4e4e-b410-9c52089502f3 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:30.313159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 986/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:31.142820 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:31.144410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:31.227416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93c0cd-05f6-4659-aded-cf687d15b1dd service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:31.234720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:31.235380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:31.236517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:31.236948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] PATH_INFO: `/v3/users/7bf95321b9554800ad86194f1560b1c1` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:31.238315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf95321b9554800ad86194f1560b1c1)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:31.240312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:31.301042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:31.309951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf95321b9554800ad86194f1560b1c1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:31.327564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf95321b9554800ad86194f1560b1c1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:31.328402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf95321b9554800ad86194f1560b1c1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:31.344618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf95321b9554800ad86194f1560b1c1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:31.346257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf95321b9554800ad86194f1560b1c1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:31.373836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 985/1971] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:31 2022] DELETE /identity/v3/users/7bf95321b9554800ad86194f1560b1c1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:31.378110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:31.378620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:31.378717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:31.405462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:31.408413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:31.556402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 987/1972] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:31.565368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:31.567484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:31.662988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:31.664491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:31.694214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81c76-5dc7-41ed-946f-582f9773afd4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:31.699808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea34d3-da3a-4e37-99b8-9b58fe944b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:31.700770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea34d3-da3a-4e37-99b8-9b58fe944b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:31.701050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea34d3-da3a-4e37-99b8-9b58fe944b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:31.701324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea34d3-da3a-4e37-99b8-9b58fe944b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:31.701681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:31.716763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea34d3-da3a-4e37-99b8-9b58fe944b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:31.719822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea34d3-da3a-4e37-99b8-9b58fe944b26 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:31.737104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 986/1973] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:31.791374 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b741e8-3e8a-487f-86c1-de45a3cac816 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:31.796004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:31.798695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:31.798973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:31.799249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:31.801355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:31.916919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:31.918445 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:31.936079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 988/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:32.121770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fc08-b21f-436f-976f-170f5ec51913 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:32.122214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fc08-b21f-436f-976f-170f5ec51913 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:32.122509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fc08-b21f-436f-976f-170f5ec51913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:32.158821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f354fc08-b21f-436f-976f-170f5ec51913 None None] MFA Rules not processed for user `6b53b2fbfb31429387e68f47f2650403`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:32.161586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f354fc08-b21f-436f-976f-170f5ec51913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:32.249305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 987/1975] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:32.270334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:32.273199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:32.307015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bceb1c-8b33-4025-a226-7bbae8f49747 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:32.320089 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:32.321531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:32.321898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:32.322182 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] PATH_INFO: `/v3/projects/db077ff9d4504d20a3f2fd1dbb43d46d` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:32.323674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db077ff9d4504d20a3f2fd1dbb43d46d)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:32.326368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:32.432118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db077ff9d4504d20a3f2fd1dbb43d46d', 'request_id': 'req-4bcce129-a035-4e7d-a235-95a1f2d4494e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:32.445829 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db077ff9d4504d20a3f2fd1dbb43d46d', 'request_id': 'req-4bcce129-a035-4e7d-a235-95a1f2d4494e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:32.465012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db077ff9d4504d20a3f2fd1dbb43d46d', 'request_id': 'req-4bcce129-a035-4e7d-a235-95a1f2d4494e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:32.492440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] The token cache is being invalidate because project db077ff9d4504d20a3f2fd1dbb43d46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:32.492751 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:32.493604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-4bcce129-a035-4e7d-a235-95a1f2d4494e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:32.502146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:32.502695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:32.503043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 989/1976] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:32 2022] DELETE /identity/v3/projects/db077ff9d4504d20a3f2fd1dbb43d46d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:32.503456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:32.548148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:32.552436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:32.687663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 988/1977] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:32.696912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:32.697958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:32.698361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:32.736953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:32.738503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:32.755296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 990/1978] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:32.759856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:32.767581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:32.773062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dfe6d-cf6a-49bb-8be8-4a96dc4f7139 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:32.784661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:32.785510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:32.785848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:32.786448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:32.788031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:32.788708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:32.790946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:32.817404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 989/1979] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:32.819515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:32.834922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce74d60-3b3e-4e04-bcd2-67749bad8f3d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:32.847191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:32.848994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:32.851247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:32.851548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:32.852211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:32.854419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:32.903831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:32.905011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 991/1980] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:32 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:32.915790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae17d-fa52-4494-a705-8a53c23820f6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:32.950607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:32.952346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:33.001049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:33.001847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.002227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.003020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.003353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:33.005638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:33.025080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:33.042956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 990/1981] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:32 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:33.048405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:33.064222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af6e9a-f001-4851-abe0-017d92630e5f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:33.071482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:33.072110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.072389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.072663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.073320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:33.074948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:33.089891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 991/1982] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:33.095151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:33.107940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93e72-bde6-4603-90eb-61b456702c5a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:33.117383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:33.118610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93477e9-809e-47d5-87fb-e56e80a6bf19 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:33.119682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.120108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.121138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.122976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:33.126588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:33.129683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:33.130434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.131990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.131990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.137354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:33.148652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 992/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:33.156287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:33.174273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e407520-c537-4c0a-9654-28d8a5629565 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:33.184970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:33.186071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.187348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.187702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] PATH_INFO: `/v3/projects/42c50fe7d7fa420b9f48379c286b2803/users/4244f0177879474f8390200c398fd344/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.258587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c50fe7d7fa420b9f48379c286b2803, user_id=4244f0177879474f8390200c398fd344, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:33.279572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:33.295691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:33.297379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cb1bf-6905-4d0b-b010-041087b5ea6a service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:33.323786 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 992/1984] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:33.325756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 993/1985] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:33 2022] PUT /identity/v3/projects/42c50fe7d7fa420b9f48379c286b2803/users/4244f0177879474f8390200c398fd344/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:33.336964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.337390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.337834 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.425290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] MFA Rules not processed for user `4244f0177879474f8390200c398fd344`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:33.426583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:33.635719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 993/1986] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:33.700876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:33.707113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:33.831518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c6fa-7638-4ad1-b8a8-f5f80acc4281 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:33.839582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddfb27-5127-4320-b7e1-832cb93da564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:33.840450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfb27-5127-4320-b7e1-832cb93da564 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:33.842157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfb27-5127-4320-b7e1-832cb93da564 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:33.843734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfb27-5127-4320-b7e1-832cb93da564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:33.857843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddfb27-5127-4320-b7e1-832cb93da564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:33.860828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddfb27-5127-4320-b7e1-832cb93da564 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:33.872324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 994/1987] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:33.902982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:34.020577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10594a49-bf36-42a0-b38b-bc1f06feed14 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:34.026651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:34.027386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:34.027666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:34.027991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] PATH_INFO: `/v3/users/4244f0177879474f8390200c398fd344` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:34.029076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4244f0177879474f8390200c398fd344)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:34.031203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:34.038731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:34.123844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4244f0177879474f8390200c398fd344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:34.123844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4244f0177879474f8390200c398fd344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:34.129947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4244f0177879474f8390200c398fd344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:34.136623 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4244f0177879474f8390200c398fd344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:34.146025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4244f0177879474f8390200c398fd344'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:34.173367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 994/1988] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:33 2022] DELETE /identity/v3/users/4244f0177879474f8390200c398fd344 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:34.180722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:34.182078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:34.182612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:34.226618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:34.227988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:34.267582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:34.307534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 995/1989] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:34.320296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:34.322587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:34.420717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf5f83-29be-46bf-8fcc-fe74dc12ce9d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:34.430610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ff68c-209d-4acc-8956-cdc7f29a85fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:34.431221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ff68c-209d-4acc-8956-cdc7f29a85fc service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:34.431498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ff68c-209d-4acc-8956-cdc7f29a85fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:34.431861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ff68c-209d-4acc-8956-cdc7f29a85fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:34.466983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ff68c-209d-4acc-8956-cdc7f29a85fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:34.471642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ff68c-209d-4acc-8956-cdc7f29a85fc service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:34.487156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 995/1990] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:34.877530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:34.879197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:34.899289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3e39f-cd0a-4c06-a43c-d291eacd5f9c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:34.909146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:34.909865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:34.910731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:34.911012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] PATH_INFO: `/v3/projects/42c50fe7d7fa420b9f48379c286b2803` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:34.913553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c50fe7d7fa420b9f48379c286b2803)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:34.917532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.009356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c50fe7d7fa420b9f48379c286b2803', 'request_id': 'req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.017220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c50fe7d7fa420b9f48379c286b2803', 'request_id': 'req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.034666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c50fe7d7fa420b9f48379c286b2803', 'request_id': 'req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.069428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] The token cache is being invalidate because project 42c50fe7d7fa420b9f48379c286b2803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:35.069428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.082382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.084693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 996/1991] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:34 2022] DELETE /identity/v3/projects/42c50fe7d7fa420b9f48379c286b2803 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:35.089779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304a1b-0e2f-4190-879b-e7d1f6bcd5e8 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.090245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304a1b-0e2f-4190-879b-e7d1f6bcd5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.090321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304a1b-0e2f-4190-879b-e7d1f6bcd5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.130535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-32304a1b-0e2f-4190-879b-e7d1f6bcd5e8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:35.132997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-32304a1b-0e2f-4190-879b-e7d1f6bcd5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:35.258453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.264928 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:35.317909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 996/1992] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:35.328684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.328964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.329237 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.351930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:35.353139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:35.380524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 997/1993] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:35.385260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.395867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9eb9c-f81f-4ffd-9dfb-f7e420164acf admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.402947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.403948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.404379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.404823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] PATH_INFO: `/v3/users/31c26249f3ba4a999b3932a929418291` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.405031 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d4ff4-ba75-487e-8916-f209bd4d1428 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.406368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c26249f3ba4a999b3932a929418291)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:35.410171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.412482 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.413362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.414049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.429263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.431016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:35.431627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:35.433477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.448318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 998/1994] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:35.452788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.468059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fddf86-d77c-46ee-abab-bfd6ecded6e3 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.476795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.478155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.479812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.480274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.481976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:35.485005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.493300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:35.506292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c26249f3ba4a999b3932a929418291'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.529021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c26249f3ba4a999b3932a929418291'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.529839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c26249f3ba4a999b3932a929418291'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.537902 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 999/1995] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:35 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:35.543958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.551194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c26249f3ba4a999b3932a929418291'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.552091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ad912321-f5fe-4596-bc83-4f5a3f381ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c26249f3ba4a999b3932a929418291'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:35.554096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:35.607554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 997/1996] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:35 2022] DELETE /identity/v3/users/31c26249f3ba4a999b3932a929418291 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:35.609005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.609294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.609569 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.654148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:35.655308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:35.743605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482e95e-979f-4b98-a72a-dce6dce7f3a7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.850434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.851756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.852418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.852768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.853914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:35.856615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.882129 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 998/1997] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:35.892680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1000/1998] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:35 2022] POST /identity/v3/users => generated 294 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:35.894215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.896827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.897175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:35.904954 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:35.917516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fd2ca-857c-41d5-8941-75c385bd4729 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.922331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.922943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.923220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.923483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.924118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:35.925714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.937150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1001/1999] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:35.941633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:35.966134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f64b0-b79a-48ff-981d-36f8155c41e7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.972293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.973046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.973466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.973710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:35.974667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:35.977295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:35.980670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4f429-7942-435c-a439-c844d974e4d9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:35.987222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b448b-ef1b-45a1-8fae-73bb0b70b92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:35.987993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b448b-ef1b-45a1-8fae-73bb0b70b92d service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:35.988686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b448b-ef1b-45a1-8fae-73bb0b70b92d service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:35.989620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b448b-ef1b-45a1-8fae-73bb0b70b92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:36.000595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1002/2000] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:36.007927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:36.010931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b448b-ef1b-45a1-8fae-73bb0b70b92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:36.012797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b448b-ef1b-45a1-8fae-73bb0b70b92d service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:36.019334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286717-c356-4ec6-9b0b-1bbf9d0fe84e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:36.024310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:36.024975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:36.025247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:36.025514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] PATH_INFO: `/v3/projects/5bdaa63f7b6942e8910b50057cedeae2/users/2e4d42e7e68b4ab8b739fcfe09303c42/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:36.025770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 999/2001] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:36.043566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdaa63f7b6942e8910b50057cedeae2, user_id=2e4d42e7e68b4ab8b739fcfe09303c42, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:36.046574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:36.069988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1003/2002] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:36 2022] PUT /identity/v3/projects/5bdaa63f7b6942e8910b50057cedeae2/users/2e4d42e7e68b4ab8b739fcfe09303c42/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:36.077827 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:36.078116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:36.078388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:36.118914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] MFA Rules not processed for user `2e4d42e7e68b4ab8b739fcfe09303c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:36.120340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:36.215808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1000/2003] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:36.237018 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:36.240696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:36.301648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:36.325598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed55d-0594-4f50-96b0-55a0b30e129e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:36.329897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:36.330742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:36.331116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:36.331475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:36.344197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:36.346134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:36.360207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1004/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:36.451286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:36.453649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:36.479791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:36.580933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d55a4b-4a47-4984-9ade-0bab5746ea40 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:36.589021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:36.590014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:36.590448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:36.590874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] PATH_INFO: `/v3/projects/8f86257f6e8c4dfba109cc777c6273a9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:36.592301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f86257f6e8c4dfba109cc777c6273a9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:36.601270 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:36.689389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f86257f6e8c4dfba109cc777c6273a9', 'request_id': 'req-c09da17a-8c04-41f3-9f8c-f19da822356e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:36.698137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f86257f6e8c4dfba109cc777c6273a9', 'request_id': 'req-c09da17a-8c04-41f3-9f8c-f19da822356e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:36.707523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f86257f6e8c4dfba109cc777c6273a9', 'request_id': 'req-c09da17a-8c04-41f3-9f8c-f19da822356e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:36.723845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] The token cache is being invalidate because project 8f86257f6e8c4dfba109cc777c6273a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:36.724931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:36.726872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:36.729884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1001/2005] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:36 2022] DELETE /identity/v3/projects/8f86257f6e8c4dfba109cc777c6273a9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:36.735610 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:36.751247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5a055-5d59-4d0a-811f-9def3c6e9c51 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:36.892320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:36.892984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:36.893266 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:36.893538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] PATH_INFO: `/v3/users/3c0cbf67eb154314b045da03b7ef65cf` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:36.895755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0cbf67eb154314b045da03b7ef65cf)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:36.898630 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:37.010762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0cbf67eb154314b045da03b7ef65cf'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.014520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0cbf67eb154314b045da03b7ef65cf'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.025239 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0cbf67eb154314b045da03b7ef65cf'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.026174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0cbf67eb154314b045da03b7ef65cf'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.048766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0cbf67eb154314b045da03b7ef65cf'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.094072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1005/2006] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:36 2022] DELETE /identity/v3/users/3c0cbf67eb154314b045da03b7ef65cf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:37.414791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:37.416070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:37.432400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da17a-8c04-41f3-9f8c-f19da822356e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:37.518395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:37.520085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:37.520467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:37.520843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] PATH_INFO: `/v3/projects/e954e14822f341789f6a0fb7c00dee32` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:37.522269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e954e14822f341789f6a0fb7c00dee32)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:37.524451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:37.577381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:37.580412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e954e14822f341789f6a0fb7c00dee32', 'request_id': 'req-5c578840-35cc-45bf-b8e6-e3f02667e006'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.588776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e954e14822f341789f6a0fb7c00dee32', 'request_id': 'req-5c578840-35cc-45bf-b8e6-e3f02667e006'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.597304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e954e14822f341789f6a0fb7c00dee32', 'request_id': 'req-5c578840-35cc-45bf-b8e6-e3f02667e006'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.609355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] The token cache is being invalidate because project e954e14822f341789f6a0fb7c00dee32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:37.609646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.610330 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.612061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1002/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:37 2022] DELETE /identity/v3/projects/e954e14822f341789f6a0fb7c00dee32 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:37.616437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:37.617895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:37.631068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b212f1a-b1b5-4b0f-90de-78822aab7f6f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:37.691242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:37.702821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:37.703622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:37.703914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:37.704236 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] PATH_INFO: `/v3/users/5dde2363d2984f70ab2c15d7134a900e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:37.705977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dde2363d2984f70ab2c15d7134a900e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:37.711051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:37.794001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:37.796641 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:37.800637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dde2363d2984f70ab2c15d7134a900e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.801389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dde2363d2984f70ab2c15d7134a900e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.810363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dde2363d2984f70ab2c15d7134a900e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.811310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dde2363d2984f70ab2c15d7134a900e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.813254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c578840-35cc-45bf-b8e6-e3f02667e006 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:37.818792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:37.819442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:37.819758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:37.820098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] PATH_INFO: `/v3/users/c6180c5c918846bf962cc54e9c92f08e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:37.820378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-734d2088-af8e-43bf-948a-e1f269a24961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dde2363d2984f70ab2c15d7134a900e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.821658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6180c5c918846bf962cc54e9c92f08e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:37.824701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:37.842150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1006/2008] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:37 2022] DELETE /identity/v3/users/5dde2363d2984f70ab2c15d7134a900e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:37.887674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6180c5c918846bf962cc54e9c92f08e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.896035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6180c5c918846bf962cc54e9c92f08e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.897375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6180c5c918846bf962cc54e9c92f08e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.905594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6180c5c918846bf962cc54e9c92f08e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.906353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6180c5c918846bf962cc54e9c92f08e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:37.933346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1003/2009] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:37 2022] DELETE /identity/v3/users/c6180c5c918846bf962cc54e9c92f08e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:37.939813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:37.940884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:37.941391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:37.975874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:37.986789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:38.122234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1007/2010] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:38.142522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:38.145155 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:38.251419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e313b5-c17a-4963-ba18-692f2de6af74 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:38.259202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276a72d-6cc7-43ad-b679-5759905bf0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:38.260098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276a72d-6cc7-43ad-b679-5759905bf0ef service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.260391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276a72d-6cc7-43ad-b679-5759905bf0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.260772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276a72d-6cc7-43ad-b679-5759905bf0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.273389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:38.274835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:38.293623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276a72d-6cc7-43ad-b679-5759905bf0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:38.302056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef83ad-cc12-46f8-8223-0200dd435826 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:38.307460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276a72d-6cc7-43ad-b679-5759905bf0ef service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:38.331703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:38.334547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.334985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.335396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] PATH_INFO: `/v3/projects/acb8d5608e2b4ba1b5c64cb24c6a02a1` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.341104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb8d5608e2b4ba1b5c64cb24c6a02a1)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:38.343844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:38.346639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1004/2011] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:38.419920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb8d5608e2b4ba1b5c64cb24c6a02a1', 'request_id': 'req-f87650e6-d569-4058-b2ab-a75a14c7bf21'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:38.434500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb8d5608e2b4ba1b5c64cb24c6a02a1', 'request_id': 'req-f87650e6-d569-4058-b2ab-a75a14c7bf21'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:38.451892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb8d5608e2b4ba1b5c64cb24c6a02a1', 'request_id': 'req-f87650e6-d569-4058-b2ab-a75a14c7bf21'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:38.467372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:38.472219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] The token cache is being invalidate because project acb8d5608e2b4ba1b5c64cb24c6a02a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:38.472514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:38.473264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f87650e6-d569-4058-b2ab-a75a14c7bf21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:38.476288 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1008/2012] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:38 2022] DELETE /identity/v3/projects/acb8d5608e2b4ba1b5c64cb24c6a02a1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:38.481373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.481780 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.482032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.523767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:38.525872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:38.597635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:38.629903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1005/2013] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:38.696698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.697265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.697527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.723809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:38.725901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:38.750164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1009/2014] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:38.754573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:38.769831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9013fef-05f5-43a7-a314-015fb9b513fd None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:38.781252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:38.782023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.782331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.783186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.783856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:38.784193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:38.785934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:38.812797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1006/2015] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:03:38.816696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:38.845720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766607-afc5-4aa3-87ce-1e65c0b1d7a5 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:38.851955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:38.852656 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.853159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.853637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.854525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:38.856964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:38.889210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1010/2016] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:38 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:38.893531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:38.903744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a05e-283a-492b-8694-b634db76a889 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:38.931073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:38.933032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:38.985227 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:38.985890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:38.986200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:38.986479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:38.987715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:38.990054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.015005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1007/2017] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:38 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:39.016813 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc03ff-3036-4dc5-8dfd-786a360923e6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.020060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.022580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.022927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.023208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.023479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] PATH_INFO: `/v3/projects/24030d5e74ca478ea0e99f798d27650e` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.024685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24030d5e74ca478ea0e99f798d27650e)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.027022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.031417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdabf-546b-443b-b968-9bee7587522e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.036934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.037668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.037981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.038276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.038889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.040484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.054223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1008/2018] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:39.058093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.069011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe08b5-3638-4483-9d3f-7c01eb705019 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.078414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24030d5e74ca478ea0e99f798d27650e', 'request_id': 'req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.085890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24030d5e74ca478ea0e99f798d27650e', 'request_id': 'req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.096025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24030d5e74ca478ea0e99f798d27650e', 'request_id': 'req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.110470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] The token cache is being invalidate because project 24030d5e74ca478ea0e99f798d27650e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:39.110974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.111651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.113616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1011/2019] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:38 2022] DELETE /identity/v3/projects/24030d5e74ca478ea0e99f798d27650e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:39.117927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.119214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:39.134090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.134779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.135120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.135485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.136313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.138726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.149812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1009/2020] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:39.153961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.155694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:39.171099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094bc69-241c-4714-be00-ca7469d3a7f7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.176046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25042-2fda-4843-893f-024b2fe6ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.176751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25042-2fda-4843-893f-024b2fe6ffb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.177027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25042-2fda-4843-893f-024b2fe6ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.177301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25042-2fda-4843-893f-024b2fe6ffb5 admin admin] PATH_INFO: `/v3/projects/1e569cf58957469ba65e10db95cbb5f0/users/008a4bd62a22481e96d52699baa86401/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.192322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d10-38d3-4b0e-b5fb-530472b875a3 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.192832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f25042-2fda-4843-893f-024b2fe6ffb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e569cf58957469ba65e10db95cbb5f0, user_id=008a4bd62a22481e96d52699baa86401, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.195628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f25042-2fda-4843-893f-024b2fe6ffb5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.197161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.197850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.198131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.198395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] PATH_INFO: `/v3/users/bf941115a35b4a358fa13d18082e01f2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.199643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf941115a35b4a358fa13d18082e01f2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.202355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.204999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:39.210356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1010/2021] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:39 2022] PUT /identity/v3/projects/1e569cf58957469ba65e10db95cbb5f0/users/008a4bd62a22481e96d52699baa86401/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:39.220605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.220978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.221343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.251520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] MFA Rules not processed for user `008a4bd62a22481e96d52699baa86401`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:39.252775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:39.260683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf941115a35b4a358fa13d18082e01f2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.261402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf941115a35b4a358fa13d18082e01f2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.266464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:39.269479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf941115a35b4a358fa13d18082e01f2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.270189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf941115a35b4a358fa13d18082e01f2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.277710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf941115a35b4a358fa13d18082e01f2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:39.296136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1012/2022] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:39 2022] DELETE /identity/v3/users/bf941115a35b4a358fa13d18082e01f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:39.322584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1011/2023] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:39.335119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.336664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:39.404702 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb52a-721c-441f-b1a9-9094f94063a1 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.408713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.409322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.409592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.409891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.477805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.477805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.488419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1013/2024] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:39.674656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.676625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:39.853388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45051d2e-9e8c-49c5-aa78-4b4244215adf None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.930810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.931474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.931728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.931999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] PATH_INFO: `/v3/projects/49cda07a59824ba29284f33214d3c212` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.933133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cda07a59824ba29284f33214d3c212)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.935738 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:39.948460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:39.949905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:39.981184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca985a4-a567-4fa9-a4d5-f4dcd8d211fb service glance] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:39.987695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:39.988121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:39.988395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:39.988665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] PATH_INFO: `/v3/users/4f37208f32294e89a24c1a9a205a3034` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:39.990726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f37208f32294e89a24c1a9a205a3034)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:39.992502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:40.042214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cda07a59824ba29284f33214d3c212', 'request_id': 'req-7a8bf813-e15d-46f8-a9c0-a7f518802f37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.042732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:40.051857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cda07a59824ba29284f33214d3c212', 'request_id': 'req-7a8bf813-e15d-46f8-a9c0-a7f518802f37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.069515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cda07a59824ba29284f33214d3c212', 'request_id': 'req-7a8bf813-e15d-46f8-a9c0-a7f518802f37'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.070216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f37208f32294e89a24c1a9a205a3034'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.074382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f37208f32294e89a24c1a9a205a3034'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.078194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:40.086476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] The token cache is being invalidate because project 49cda07a59824ba29284f33214d3c212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:40.086798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.088289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.092888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1012/2025] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:39 2022] DELETE /identity/v3/projects/49cda07a59824ba29284f33214d3c212 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:40.094294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f37208f32294e89a24c1a9a205a3034'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.094609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:40.095190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f37208f32294e89a24c1a9a205a3034'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.097927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:40.115744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-070c83e8-b07c-4e86-8550-088b49e348d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f37208f32294e89a24c1a9a205a3034'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.160588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1014/2026] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:39 2022] DELETE /identity/v3/users/4f37208f32294e89a24c1a9a205a3034 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:40.162441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:40.162718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:40.163002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:40.191190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:40.194550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:40.214356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf813-e15d-46f8-a9c0-a7f518802f37 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:40.285712 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1015/2027] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:40.296993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:40.299827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:40.365510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:40.366422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:40.366914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:40.367267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] PATH_INFO: `/v3/users/4ffd2d028d2d45a4b5d91a764a5fba6f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:40.368540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffd2d028d2d45a4b5d91a764a5fba6f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:40.370623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:40.400081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f45dd-219c-4da1-b92b-0ce9c861c587 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:40.405047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:40.405719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:40.406026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:40.406322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:40.416949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:40.418611 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:40.429764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1016/2028] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:40.443680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffd2d028d2d45a4b5d91a764a5fba6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.454199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffd2d028d2d45a4b5d91a764a5fba6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.455231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffd2d028d2d45a4b5d91a764a5fba6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.468370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffd2d028d2d45a4b5d91a764a5fba6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.469366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffd2d028d2d45a4b5d91a764a5fba6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:40.493927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1013/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:40 2022] DELETE /identity/v3/users/4ffd2d028d2d45a4b5d91a764a5fba6f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:40.847141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:40.853575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:40.885054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3830-b62a-427f-bddb-9bc41b7b7055 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:40.946453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:40.948387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:40.952291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:40.985398 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:40.986534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:40.988150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:40.988524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] PATH_INFO: `/v3/projects/d0195cc54cac4d27b15e4106c99e12d9` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:40.990864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0195cc54cac4d27b15e4106c99e12d9)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:40.994367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:40.997860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:41.077548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786545-1aa1-4e49-875f-1e042600604f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.109886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0195cc54cac4d27b15e4106c99e12d9', 'request_id': 'req-2b456aaf-7bcd-45a1-b922-233567cc8abb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.122226 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0195cc54cac4d27b15e4106c99e12d9', 'request_id': 'req-2b456aaf-7bcd-45a1-b922-233567cc8abb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.150731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0195cc54cac4d27b15e4106c99e12d9', 'request_id': 'req-2b456aaf-7bcd-45a1-b922-233567cc8abb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.213877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.214543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.215029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.215409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] PATH_INFO: `/v3/projects/65c44cfa9250485b8c7690003cc226e5` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.216583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c44cfa9250485b8c7690003cc226e5)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.216854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] The token cache is being invalidate because project d0195cc54cac4d27b15e4106c99e12d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:41.217152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.218672 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.220233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-2b456aaf-7bcd-45a1-b922-233567cc8abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.226184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1017/2030] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:40 2022] DELETE /identity/v3/projects/d0195cc54cac4d27b15e4106c99e12d9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:41.245793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96508db-abff-460f-84a9-bfde1f702652 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.246232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96508db-abff-460f-84a9-bfde1f702652 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.247694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96508db-abff-460f-84a9-bfde1f702652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.301120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d96508db-abff-460f-84a9-bfde1f702652 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:41.302282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c44cfa9250485b8c7690003cc226e5', 'request_id': 'req-e4c506a4-58ab-481a-a67d-920b239a8c6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.303397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d96508db-abff-460f-84a9-bfde1f702652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:41.309562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c44cfa9250485b8c7690003cc226e5', 'request_id': 'req-e4c506a4-58ab-481a-a67d-920b239a8c6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.320192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c44cfa9250485b8c7690003cc226e5', 'request_id': 'req-e4c506a4-58ab-481a-a67d-920b239a8c6f'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.342136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] The token cache is being invalidate because project 65c44cfa9250485b8c7690003cc226e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:41.342372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.343696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e4c506a4-58ab-481a-a67d-920b239a8c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:41.345287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1014/2031] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:40 2022] DELETE /identity/v3/projects/65c44cfa9250485b8c7690003cc226e5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:41.351363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.351495 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.351673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.379489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:41.387171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:41.402016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1018/2032] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:41.402217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1015/2033] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:41.404440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dcf56-cb6f-4cb1-9d0f-c4fb2477f205 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.404720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dcf56-cb6f-4cb1-9d0f-c4fb2477f205 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.404993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dcf56-cb6f-4cb1-9d0f-c4fb2477f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.428883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ea9dcf56-cb6f-4cb1-9d0f-c4fb2477f205 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:41.430952 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ea9dcf56-cb6f-4cb1-9d0f-c4fb2477f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:41.441041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1019/2034] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:41.446386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.461099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e46263-e24e-467f-aee0-949b5d405d2e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.465576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.465888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.466164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.466346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.466961 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.467243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.467512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.468155 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:41.468453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.470102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.483440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1016/2035] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:03:41.487666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.488063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:41.489249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:41.500970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1020/2036] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:41.501202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5e1f-aa3d-493b-8996-b2bf0af730bf admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.502033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.505237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.505932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.506233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.506581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.507482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.509491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.512224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c196cdd-0701-4fbf-81f0-feaaf80b43ea None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.516817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.517410 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.517690 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.517991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.518637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:41.518937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.520522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.541531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1021/2037] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:03:41.542631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.542744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1017/2038] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:41.546526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.552402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4e86-ecbf-41f4-925e-472e73df75f8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.566574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:41.608755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:41.616779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10bdd0-eb79-4053-b00f-b95058eb2dc6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.618029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.618977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.619406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.619728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.620692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.621621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.622255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.622534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.622805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.623213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.623427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.625335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.653117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1018/2039] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:41.657094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.660537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1022/2040] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:41.664827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.671550 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc679-e523-44bb-8dc9-d6b8e16ad6ff admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.742396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08369-0688-4400-92c5-c26b498d96ac admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.746311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.746951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.747235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.747509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.747670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.748341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.748687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.749054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.749162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.749915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.750709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.751841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.765792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1019/2041] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:41.767714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.781897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f4b5-3c77-4407-956c-c41643b580c2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.782358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1023/2042] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:41.787194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.787733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.788809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.789089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.789369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.790028 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.791768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.799027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12df2-0c8f-4602-a4f4-514552659c6c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.805800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1020/2043] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:41.811577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.811919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.811919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.811919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.811919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.812437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.816330 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.827517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682078-6bac-4aab-8861-be0922c83441 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.829280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1024/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:41.833841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.834067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c590e4-22f2-4ec2-b900-15a5a2358b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.834942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c590e4-22f2-4ec2-b900-15a5a2358b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.835225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c590e4-22f2-4ec2-b900-15a5a2358b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.835502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c590e4-22f2-4ec2-b900-15a5a2358b88 admin admin] PATH_INFO: `/v3/projects/fa3af570b0af4abe913bfc4ddf1e5873/users/e8b129ce64604e7d8154cecba20f3536/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.845305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b55dd-2406-4f55-b679-fc14843d8f33 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.852301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.853437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.853727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.854071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.854718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.854870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c590e4-22f2-4ec2-b900-15a5a2358b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3af570b0af4abe913bfc4ddf1e5873, user_id=e8b129ce64604e7d8154cecba20f3536, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:41.856648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.857955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c590e4-22f2-4ec2-b900-15a5a2358b88 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:41.870192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1025/2045] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:41.874502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1021/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:41 2022] PUT /identity/v3/projects/fa3af570b0af4abe913bfc4ddf1e5873/users/e8b129ce64604e7d8154cecba20f3536/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:41.875348 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:41.882751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.883220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.883347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.888881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5b876-f98c-45a1-80ba-2083dae1e886 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:41.908915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:41.910601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:41.974621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91202a9a-abed-4c5c-8474-411c9b77aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:41.976263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91202a9a-abed-4c5c-8474-411c9b77aa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:41.976861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91202a9a-abed-4c5c-8474-411c9b77aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:41.977291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91202a9a-abed-4c5c-8474-411c9b77aa37 admin admin] PATH_INFO: `/v3/projects/952f1d1277ec421ea564b51a84571cfa/users/77436462fe634c5f89d1e44b9b5ea1dc/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:41.988698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1022/2047] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:41.996691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91202a9a-abed-4c5c-8474-411c9b77aa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952f1d1277ec421ea564b51a84571cfa, user_id=77436462fe634c5f89d1e44b9b5ea1dc, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:42.000215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:42.000588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91202a9a-abed-4c5c-8474-411c9b77aa37 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:42.001870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:42.014415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:42.018457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1026/2048] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:41 2022] PUT /identity/v3/projects/952f1d1277ec421ea564b51a84571cfa/users/77436462fe634c5f89d1e44b9b5ea1dc/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:03:42.025196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:42.025489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:42.025783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:42.049217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:42.050624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:42.074970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563670-4fe3-45b6-bedd-e4c28a6fcc5a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:42.079849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:42.118684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1027/2049] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:42.128325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:42.129753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230603d4-12d1-447e-ad2a-ae98ab0ad5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:42.130494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230603d4-12d1-447e-ad2a-ae98ab0ad5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:42.130974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230603d4-12d1-447e-ad2a-ae98ab0ad5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:42.131479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230603d4-12d1-447e-ad2a-ae98ab0ad5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:42.138989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c509-7078-4daa-bcf9-5bcbc5b0df6d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:42.143255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e4af4-9699-49bd-90f9-63a145cb5678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:42.143717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230603d4-12d1-447e-ad2a-ae98ab0ad5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:42.143945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4af4-9699-49bd-90f9-63a145cb5678 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:42.144108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4af4-9699-49bd-90f9-63a145cb5678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:42.144405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4af4-9699-49bd-90f9-63a145cb5678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:42.145252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230603d4-12d1-447e-ad2a-ae98ab0ad5f7 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:42.154695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e4af4-9699-49bd-90f9-63a145cb5678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:42.156323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1023/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:42.156438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e4af4-9699-49bd-90f9-63a145cb5678 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:42.168818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1028/2051] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:43.585190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683e4e3-9806-4607-97da-630ca537876e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:43.586187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683e4e3-9806-4607-97da-630ca537876e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:43.586538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683e4e3-9806-4607-97da-630ca537876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:43.590779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:43.591554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:43.591993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:43.626835 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] MFA Rules not processed for user `77436462fe634c5f89d1e44b9b5ea1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:43.628329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:43.639106 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8683e4e3-9806-4607-97da-630ca537876e None None] MFA Rules not processed for user `e8b129ce64604e7d8154cecba20f3536`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:43.641191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8683e4e3-9806-4607-97da-630ca537876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:43.743191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1029/2052] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:43.754523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:43.757130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:43.762275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1024/2053] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:43.769252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683e4e3-9806-4607-97da-630ca537876e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:43.771352 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8683e4e3-9806-4607-97da-630ca537876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:43.852401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683e4e3-9806-4607-97da-630ca537876e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:43.860070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:43.860804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:43.861173 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:43.861536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:43.866063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04928f50-6b8b-413b-a246-a156462a5063 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:43.871278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:43.872842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:43.873390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:43.873856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:43.876383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:43.881788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:43.888027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:43.892470 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:43.894773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:43.909373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1025/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:43.912884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1030/2055] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:45.058721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:45.060920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:45.084647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623d7a-0287-4e73-b784-e64359889356 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:45.089387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:45.090073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:45.090348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:45.090616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] PATH_INFO: `/v3/users/ea1d6596882a4ec6b0d6ae6fb1ad397e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:45.091720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1d6596882a4ec6b0d6ae6fb1ad397e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:45.093642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:45.150257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1d6596882a4ec6b0d6ae6fb1ad397e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.166023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1d6596882a4ec6b0d6ae6fb1ad397e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.166023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1d6596882a4ec6b0d6ae6fb1ad397e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.167601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1d6596882a4ec6b0d6ae6fb1ad397e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.168301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-31f9a024-df43-4028-8737-43fc15cb7bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1d6596882a4ec6b0d6ae6fb1ad397e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.190541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1026/2056] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:45 2022] DELETE /identity/v3/users/ea1d6596882a4ec6b0d6ae6fb1ad397e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:45.363197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:45.375373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e28eb-2046-460b-9d38-20d48cc7187b service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:45.427425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:45.437727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:45.438387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:45.438667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:45.438940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] PATH_INFO: `/v3/projects/5fdd0b6767a44db78c52d0d4223667ae` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:45.440058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fdd0b6767a44db78c52d0d4223667ae)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:45.442601 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:45.482252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe3671-17f2-4092-9cbc-1485e002327a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:45.482535 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe3671-17f2-4092-9cbc-1485e002327a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:45.482812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe3671-17f2-4092-9cbc-1485e002327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:45.491914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fdd0b6767a44db78c52d0d4223667ae', 'request_id': 'req-6f508f4c-a7e6-4427-b51f-3b107a880f41'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.502426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fdd0b6767a44db78c52d0d4223667ae', 'request_id': 'req-6f508f4c-a7e6-4427-b51f-3b107a880f41'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.502633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-92fe3671-17f2-4092-9cbc-1485e002327a None None] MFA Rules not processed for user `77436462fe634c5f89d1e44b9b5ea1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:45.503851 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-92fe3671-17f2-4092-9cbc-1485e002327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:45.512025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fdd0b6767a44db78c52d0d4223667ae', 'request_id': 'req-6f508f4c-a7e6-4427-b51f-3b107a880f41'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.524697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] The token cache is being invalidate because project 5fdd0b6767a44db78c52d0d4223667ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:45.524968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.525647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.530357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1031/2057] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:45 2022] DELETE /identity/v3/projects/5fdd0b6767a44db78c52d0d4223667ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:45.531191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:45.533441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:45.611110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1027/2058] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:45.611110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:45.611110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:45.611110 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:45.635467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] MFA Rules not processed for user `e8b129ce64604e7d8154cecba20f3536`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:45.636670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:45.637620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f508f4c-a7e6-4427-b51f-3b107a880f41 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:45.647543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:45.648424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:45.648845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:45.649554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] PATH_INFO: `/v3/users/bac4f7a705d34783a26ac0c09ed3ca9a` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:45.651311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac4f7a705d34783a26ac0c09ed3ca9a)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:45.657039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:45.714799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac4f7a705d34783a26ac0c09ed3ca9a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.715499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac4f7a705d34783a26ac0c09ed3ca9a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.717700 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1028/2059] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:45.725103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac4f7a705d34783a26ac0c09ed3ca9a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.726117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac4f7a705d34783a26ac0c09ed3ca9a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.743275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-b14de718-0183-40a3-a967-1f744a4c3774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac4f7a705d34783a26ac0c09ed3ca9a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:45.763216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:45.769198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1032/2060] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:45 2022] DELETE /identity/v3/users/bac4f7a705d34783a26ac0c09ed3ca9a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:46.163602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:46.178496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f698d3d-aef1-41b8-8f03-242c9931c789 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:46.209313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:46.258566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:46.259197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.259474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.259744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] PATH_INFO: `/v3/projects/098a6c6076f64a2fb5732b87db44122d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.260877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098a6c6076f64a2fb5732b87db44122d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:46.263112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:46.326739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098a6c6076f64a2fb5732b87db44122d', 'request_id': 'req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:46.334767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098a6c6076f64a2fb5732b87db44122d', 'request_id': 'req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:46.344368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098a6c6076f64a2fb5732b87db44122d', 'request_id': 'req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:46.362152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] The token cache is being invalidate because project 098a6c6076f64a2fb5732b87db44122d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:46.362532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:46.363374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2778c2f8-609b-4bd6-8b2f-3b6fdbdb9095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:46.368316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1029/2061] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:46 2022] DELETE /identity/v3/projects/098a6c6076f64a2fb5732b87db44122d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:46.370534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.370958 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.371060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.392513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:46.394165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:46.510576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1033/2062] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:46.515059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.515059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.515059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.541039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:46.542777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:46.558381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1030/2063] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:46.558531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:46.571995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc340-0104-4e25-a154-d191bf2f2e0e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:46.578887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:46.579599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.579877 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.580144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.580798 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:03:46.581166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:46.582805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:46.620932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1034/2064] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:03:46.626503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:46.638890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75646f0-121f-4be5-8c61-4c9f692f9c34 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:46.644598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:46.645176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.645422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.645692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.654935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:46.662425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:46.718616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1031/2065] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:46 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:03:46.720388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:46.745443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5d480-ef56-4e75-8d0d-3bc4f832adab admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:46.902343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:46.903066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.903347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.903620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.904251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:46.906337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:46.941247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1035/2066] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:46 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:46.943609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:46.960460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f5ddb-9979-41c7-9d53-64416f162792 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:46.979540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:46.981389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:46.981657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:46.983598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:46.984374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:46.989388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.026293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1032/2067] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:47.030392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.044853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807c77-c52a-444d-ae2f-44b4d779df30 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.054423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395b74-6ee9-4861-a5b6-7a5428777325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.055078 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395b74-6ee9-4861-a5b6-7a5428777325 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.055403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395b74-6ee9-4861-a5b6-7a5428777325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.055742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395b74-6ee9-4861-a5b6-7a5428777325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.056358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34395b74-6ee9-4861-a5b6-7a5428777325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.058007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34395b74-6ee9-4861-a5b6-7a5428777325 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.089004 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1036/2068] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:47.093914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.105963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cbddb-3e8e-4432-9b77-d0710a253a9e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.111819 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.115534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.117970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.118340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] PATH_INFO: `/v3/projects/8754add5197343f0bd0aaf8c86db43e0/users/2c7c5429e7bc4398a49605360a63e4f1/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.153762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8754add5197343f0bd0aaf8c86db43e0, user_id=2c7c5429e7bc4398a49605360a63e4f1, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.156571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.181185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1033/2069] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:47 2022] PUT /identity/v3/projects/8754add5197343f0bd0aaf8c86db43e0/users/2c7c5429e7bc4398a49605360a63e4f1/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:47.196681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.197028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.197305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.253653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] MFA Rules not processed for user `2c7c5429e7bc4398a49605360a63e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:47.255765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:47.336281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:47.346255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1037/2070] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:03:47.351275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.432394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:47.458169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f147-ef34-42c9-bcb7-96baa900f6af admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.462053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.463216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.463497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.463767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.464407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.466346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.507091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1034/2071] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:03:47 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:47.511217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.524748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453544bb-a37e-4a60-a534-d0f28978a159 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.598883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.599887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.599887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.600113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.601062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.607032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.635121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.635582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1038/2072] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:03:47 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:03:47.647917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7fdf-1867-4e11-82f9-766d866b1c33 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.653389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.654866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.655145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.655417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.656072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.657704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.669640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1035/2073] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:03:47.673860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.685308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f738ef-d76a-448a-b4e8-04b2b84f517e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.690127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.690929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.691207 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.691477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] PATH_INFO: `/v3/projects/fcb52984167448ea93050930cd8ae62f/users/46e0f9a4987e4576b526770f25ee6dca/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.707429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb52984167448ea93050930cd8ae62f, user_id=46e0f9a4987e4576b526770f25ee6dca, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.710242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.727388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1039/2074] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:47 2022] PUT /identity/v3/projects/fcb52984167448ea93050930cd8ae62f/users/46e0f9a4987e4576b526770f25ee6dca/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:47.731595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.743159 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb7ed-4a58-4406-8c35-a8fbade2d600 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.818058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a54d99-ab47-4c54-b730-71f6b38eed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.818749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a54d99-ab47-4c54-b730-71f6b38eed2c admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.819031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a54d99-ab47-4c54-b730-71f6b38eed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.819305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a54d99-ab47-4c54-b730-71f6b38eed2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.819950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a54d99-ab47-4c54-b730-71f6b38eed2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.822048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a54d99-ab47-4c54-b730-71f6b38eed2c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.832680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1036/2075] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:03:47.836805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:47.857446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb754d4-4d27-4b43-b95d-fc0e5f7893dd admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:47.862862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:47.863752 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.864036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.864307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] PATH_INFO: `/v3/projects/fcb52984167448ea93050930cd8ae62f/users/46e0f9a4987e4576b526770f25ee6dca/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.867381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb52984167448ea93050930cd8ae62f, user_id=46e0f9a4987e4576b526770f25ee6dca, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:47.870325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:47.895157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:47.895446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:47.895775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:47.898641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1040/2076] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:03:47 2022] PUT /identity/v3/projects/fcb52984167448ea93050930cd8ae62f/users/46e0f9a4987e4576b526770f25ee6dca/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:47.931136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] MFA Rules not processed for user `46e0f9a4987e4576b526770f25ee6dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:47.932621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:48.070421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1037/2077] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:48.086153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:48.094476 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:48.099475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:48.101234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:48.213066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:48.248640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a650da-08d1-45bd-b0e2-7ea076c64312 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:48.257982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379fe6-f814-4128-9171-4123d4575062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:48.258577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379fe6-f814-4128-9171-4123d4575062 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:48.258854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379fe6-f814-4128-9171-4123d4575062 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:48.259118 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379fe6-f814-4128-9171-4123d4575062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:48.260830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca58e95-d142-4154-b3e3-7688ff5bd2fe None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:48.271194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:48.271865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:48.272137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:48.272487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] PATH_INFO: `/v3/users/2e4d42e7e68b4ab8b739fcfe09303c42` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:48.274841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4d42e7e68b4ab8b739fcfe09303c42)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:48.280953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:48.377435 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4d42e7e68b4ab8b739fcfe09303c42'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:48.386271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4d42e7e68b4ab8b739fcfe09303c42'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:48.387642 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4d42e7e68b4ab8b739fcfe09303c42'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:48.392340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379fe6-f814-4128-9171-4123d4575062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:48.393836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379fe6-f814-4128-9171-4123d4575062 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:48.403808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4d42e7e68b4ab8b739fcfe09303c42'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:48.404658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4d42e7e68b4ab8b739fcfe09303c42'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:48.420928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1041/2078] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:03:48.453358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1038/2079] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:48 2022] DELETE /identity/v3/users/2e4d42e7e68b4ab8b739fcfe09303c42 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:48.458087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:48.458992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:48.459351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:48.471043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:48.521867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:48.524274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:48.640592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1042/2080] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:48.652065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:48.653684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:48.738463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce083-7d0c-4092-9fea-8c966db5967a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:48.748621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:48.749432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:48.750030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:48.752108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:48.771485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:48.773030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:48.799084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1039/2081] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:49.800522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:49.802794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:49.816799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c0dd-5290-4a23-a86f-06dad330f7b9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:49.822805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:49.823696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:49.824086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:49.824449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] PATH_INFO: `/v3/projects/5bdaa63f7b6942e8910b50057cedeae2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:49.826912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdaa63f7b6942e8910b50057cedeae2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:49.828863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:49.883257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdaa63f7b6942e8910b50057cedeae2', 'request_id': 'req-eff71bf1-800e-4ff8-abee-105d6d970f8d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:49.891678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdaa63f7b6942e8910b50057cedeae2', 'request_id': 'req-eff71bf1-800e-4ff8-abee-105d6d970f8d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:49.903696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdaa63f7b6942e8910b50057cedeae2', 'request_id': 'req-eff71bf1-800e-4ff8-abee-105d6d970f8d'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:49.919285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] The token cache is being invalidate because project 5bdaa63f7b6942e8910b50057cedeae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:49.919696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:49.920437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:49.935131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1043/2082] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:49 2022] DELETE /identity/v3/projects/5bdaa63f7b6942e8910b50057cedeae2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:53.524344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:53.525835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:53.587656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22224e-6c11-44ba-91c6-c2f0fb53a50f service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:53.603018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:53.637264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:53.637893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:53.638168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:53.638436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:53.640140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:53.700370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:53.701825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cdc2e-a341-469c-8578-5f79f65227a0 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:53.728360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1040/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:58.693649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:58.695194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:58.762259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71bf1-800e-4ff8-abee-105d6d970f8d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:58.766928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:58.767488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:58.767762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:58.768030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] PATH_INFO: `/v3/users/2c7c5429e7bc4398a49605360a63e4f1` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:58.769136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7c5429e7bc4398a49605360a63e4f1)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:58.772254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:58.803865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:58.822509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7c5429e7bc4398a49605360a63e4f1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:58.823164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7c5429e7bc4398a49605360a63e4f1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:58.830130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7c5429e7bc4398a49605360a63e4f1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:58.830795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7c5429e7bc4398a49605360a63e4f1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:58.838705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7c5429e7bc4398a49605360a63e4f1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:58.857392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1044/2084] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:58 2022] DELETE /identity/v3/users/2c7c5429e7bc4398a49605360a63e4f1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:58.861914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:58.862403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:58.862493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:58.881595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:03:58.882938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:58.942844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1041/2085] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:03:58.952335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:58.953758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:59.013198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39e62a-1eee-4671-a265-827f2f0e66d0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:59.016923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:59.017573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:59.017824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:59.018095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:59.027477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:59.029032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:59.040312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1045/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:03:59.517726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:59.519368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:03:59.531762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bafd1-c72e-4689-9e77-0a3061d9d29b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:59.536325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:59.536962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:59.537261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:59.537533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] PATH_INFO: `/v3/projects/8754add5197343f0bd0aaf8c86db43e0` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:59.538721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8754add5197343f0bd0aaf8c86db43e0)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:59.540717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:59.594732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8754add5197343f0bd0aaf8c86db43e0', 'request_id': 'req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.601545 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8754add5197343f0bd0aaf8c86db43e0', 'request_id': 'req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.609635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8754add5197343f0bd0aaf8c86db43e0', 'request_id': 'req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.613756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:59.623107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] The token cache is being invalidate because project 8754add5197343f0bd0aaf8c86db43e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:03:59.623897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.624808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.626717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1042/2087] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:03:59 2022] DELETE /identity/v3/projects/8754add5197343f0bd0aaf8c86db43e0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:03:59.631225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:03:59.641447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baff50-2335-4d68-9377-731744ffd617 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:03:59.701273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:03:59.701975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:03:59.702234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:03:59.702443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] PATH_INFO: `/v3/users/46e0f9a4987e4576b526770f25ee6dca` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:03:59.703560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e0f9a4987e4576b526770f25ee6dca)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:03:59.705478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:03:59.752729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e0f9a4987e4576b526770f25ee6dca'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.753362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e0f9a4987e4576b526770f25ee6dca'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.755763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:59.762732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e0f9a4987e4576b526770f25ee6dca'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.763496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e0f9a4987e4576b526770f25ee6dca'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.770516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3adc636b-3e00-46e3-a43f-a0353115045f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e0f9a4987e4576b526770f25ee6dca'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:03:59.788531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1046/2088] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:03:59 2022] DELETE /identity/v3/users/46e0f9a4987e4576b526770f25ee6dca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:00.102099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.104079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:00.120150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc2ceb-f754-4a7c-82a1-aa443ff2efb1 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.188515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.189193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.189474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.189775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] PATH_INFO: `/v3/projects/fcb52984167448ea93050930cd8ae62f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.190971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb52984167448ea93050930cd8ae62f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.192937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.256903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb52984167448ea93050930cd8ae62f', 'request_id': 'req-0b283abf-3aff-4f79-b032-cee8bcdb0e30'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:00.265598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb52984167448ea93050930cd8ae62f', 'request_id': 'req-0b283abf-3aff-4f79-b032-cee8bcdb0e30'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:00.280424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb52984167448ea93050930cd8ae62f', 'request_id': 'req-0b283abf-3aff-4f79-b032-cee8bcdb0e30'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:00.293686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] The token cache is being invalidate because project fcb52984167448ea93050930cd8ae62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:00.294392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:00.295594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0b283abf-3aff-4f79-b032-cee8bcdb0e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:00.298097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1043/2089] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:00 2022] DELETE /identity/v3/projects/fcb52984167448ea93050930cd8ae62f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:04:00.305643 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.306358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.306358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.334279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:00.335845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:00.410080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1047/2090] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:00.419536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.419881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.420086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.440728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:00.441973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:00.454409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1044/2091] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:00.455953 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.467343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2735-0068-4d11-98a8-7ac3f931c337 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.487225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.487955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.488325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.488726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.489970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:04:00.489970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.491697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.505631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1048/2092] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:04:00.510049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.519689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96363f8-f565-4e8c-a52a-d9c4c71af9c2 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.525726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.526362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.527411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.527411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.527587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.529485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.561785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1045/2093] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:04:00 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:00.563681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.574851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc215c-24d4-4755-b6bd-31753c833720 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.643189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.643914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.644276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.644580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.645173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.647991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.670761 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1049/2094] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:04:00 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:00.676137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.686796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff253-1e9d-40ac-88e1-1935407b50db admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.691298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.691905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.692710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.693152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.694038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.695603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.705484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1046/2095] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:04:00.710232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.720884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a669a4-8df6-487d-9f81-213382a6f527 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.726707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aeebc-c292-419b-8f55-3f8aaac1372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.727382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aeebc-c292-419b-8f55-3f8aaac1372f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.727736 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aeebc-c292-419b-8f55-3f8aaac1372f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.728117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aeebc-c292-419b-8f55-3f8aaac1372f admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.728914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aeebc-c292-419b-8f55-3f8aaac1372f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.730855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aeebc-c292-419b-8f55-3f8aaac1372f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.741790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1050/2096] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:00.745850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.756167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ffe5-a827-41d6-a196-4d1ffc045030 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.760773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.761413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.761993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.762269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] PATH_INFO: `/v3/projects/2f1807a86f314df09d99d78583e16aff/users/3c4b825bcfa44b60bcecd920fdcc4bba/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.777039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1807a86f314df09d99d78583e16aff, user_id=3c4b825bcfa44b60bcecd920fdcc4bba, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.779720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:00.792147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1047/2097] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:00 2022] PUT /identity/v3/projects/2f1807a86f314df09d99d78583e16aff/users/3c4b825bcfa44b60bcecd920fdcc4bba/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:04:00.803423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.803711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.803987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.831490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] MFA Rules not processed for user `3c4b825bcfa44b60bcecd920fdcc4bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:00.832619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:00.852937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:00.899035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1051/2098] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:00.903440 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:00.924346 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:00.967012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c29ea-000d-4482-b8ad-db1ce0d36716 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:00.971673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:00.972275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:00.972551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:00.972823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:00.973522 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:00.975512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.002117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1048/2099] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:04:00 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:01.006103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.016647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76798a7-bf41-4f45-a12c-12f46e7857e6 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.079426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.080042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.080313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.080580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.081205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.083797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.109009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1052/2100] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:04:01 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:01.110362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.121021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3fed7-7859-4e8c-acfd-8968c9723d7a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.125980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.126770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.127141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.127415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.128056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.129723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.141913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1049/2101] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:01.146864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.157588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae302b1-c86f-4ee2-acae-b0f4002047f6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.162904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c202-e739-4f11-a292-153dfdee97cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.163509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c202-e739-4f11-a292-153dfdee97cc admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.163788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c202-e739-4f11-a292-153dfdee97cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.164060 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c202-e739-4f11-a292-153dfdee97cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.164706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265c202-e739-4f11-a292-153dfdee97cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.166329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265c202-e739-4f11-a292-153dfdee97cc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.177404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1053/2102] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:01.181719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.193166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e97e3-fc90-4a6e-89e9-c6c7c7da89c7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.198311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.199142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.199414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.199684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] PATH_INFO: `/v3/projects/947e68779ad54dbe8260303eb4f2e3ea/users/1e923af2f64044c58cc625843cccad66/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.214729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947e68779ad54dbe8260303eb4f2e3ea, user_id=1e923af2f64044c58cc625843cccad66, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.217505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.230810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1050/2103] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:01 2022] PUT /identity/v3/projects/947e68779ad54dbe8260303eb4f2e3ea/users/1e923af2f64044c58cc625843cccad66/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:01.251780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.252067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.252344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.280397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] MFA Rules not processed for user `1e923af2f64044c58cc625843cccad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:01.281599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:01.345458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1054/2104] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:01.350372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.412677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfb63c-bf42-4662-b205-a9289a761467 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.417422 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.418067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.418348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.418653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.419291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.421176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.452929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1051/2105] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:04:01 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:01.454375 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.465334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0d7c-cfa6-4a69-b157-e4ab6ef1f3ac None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.498524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:01.531122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.531733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.532028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.532372 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.532930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.534916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.560916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1055/2106] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:04:01 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:01.564526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.575570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4fc9d-c550-4a66-83f4-c2c6e7221eab admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.581373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.582071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.582297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.582543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.583218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.584811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.596357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1052/2107] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:01.601057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.611351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8bec-bdb9-4443-b4a5-809009df98d5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.616769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.618543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.618543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.618919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] PATH_INFO: `/v3/projects/27ad1535672549a194b79ac697f9635b/users/1c4a9dbfd0124474b2f6cd2be3861288/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.638745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ad1535672549a194b79ac697f9635b, user_id=1c4a9dbfd0124474b2f6cd2be3861288, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.641412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.658072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1056/2108] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:01 2022] PUT /identity/v3/projects/27ad1535672549a194b79ac697f9635b/users/1c4a9dbfd0124474b2f6cd2be3861288/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:01.662805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.685010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cc5da-e852-4c15-a16e-2193543bf696 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.746250 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:01.773463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87f26-f513-456a-a256-85d5388c22b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.774400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87f26-f513-456a-a256-85d5388c22b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.775317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87f26-f513-456a-a256-85d5388c22b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.775761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87f26-f513-456a-a256-85d5388c22b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.776834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87f26-f513-456a-a256-85d5388c22b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.778722 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87f26-f513-456a-a256-85d5388c22b1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.794265 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1053/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:01.798189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:01.829248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21d7f-8ecc-479d-bdb5-c6c4801c91de admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:01.846085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:01.846481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.846804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.847818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] PATH_INFO: `/v3/projects/27ad1535672549a194b79ac697f9635b/users/1c4a9dbfd0124474b2f6cd2be3861288/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.854347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ad1535672549a194b79ac697f9635b, user_id=1c4a9dbfd0124474b2f6cd2be3861288, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:01.859395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:01.873125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1057/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:01 2022] PUT /identity/v3/projects/27ad1535672549a194b79ac697f9635b/users/1c4a9dbfd0124474b2f6cd2be3861288/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:01.887309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:01.887926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:01.888206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:01.936823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] MFA Rules not processed for user `1c4a9dbfd0124474b2f6cd2be3861288`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:01.937030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:02.052264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1054/2111] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:02.064738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:02.068665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:02.164427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f75f87-a596-4929-9de7-3bb54e2a25f5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:02.168844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:02.169966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:02.169966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:02.170197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:02.239273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:02.240805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:02.251092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1058/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:03.808782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:03.819365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a40ed-bf31-4f68-ad8c-358a2ab27911 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:03.823004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:03.823609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:03.823888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:03.824149 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:03.884978 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:03.886951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:03.897021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1055/2113] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:04.555636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:04.564092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19443-7546-4ce3-9f7a-faeb02f0db51 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:04.568074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefcb06-eec5-4cd2-bd9d-0badb3fd831c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:04.568665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefcb06-eec5-4cd2-bd9d-0badb3fd831c service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:04.568943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefcb06-eec5-4cd2-bd9d-0badb3fd831c service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:04.569213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefcb06-eec5-4cd2-bd9d-0badb3fd831c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:04.578314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefcb06-eec5-4cd2-bd9d-0badb3fd831c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:04.579755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefcb06-eec5-4cd2-bd9d-0badb3fd831c service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:04.589013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1059/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:05.294874 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:05.296351 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:05.365410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a0ff-53bc-417b-a9b4-6b850196d3dd service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:05.369966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:05.370597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:05.370872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:05.371174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] PATH_INFO: `/v3/users/008a4bd62a22481e96d52699baa86401` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:05.372298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008a4bd62a22481e96d52699baa86401)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:05.374477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:05.384188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:05.432015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008a4bd62a22481e96d52699baa86401'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:05.439441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008a4bd62a22481e96d52699baa86401'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:05.450084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008a4bd62a22481e96d52699baa86401'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:05.456580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008a4bd62a22481e96d52699baa86401'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:05.456580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008a4bd62a22481e96d52699baa86401'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:05.471812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1056/2115] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:05 2022] DELETE /identity/v3/users/008a4bd62a22481e96d52699baa86401 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:05.476852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:05.477198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:05.477562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:05.497725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:05.498937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:05.521811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:05.568058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1060/2116] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:05.577915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:05.579356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:05.638879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ce478-37d6-46d5-b67b-57d48240c1c3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:05.642586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:05.643190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:05.643471 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:05.643744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:05.652918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:05.654366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:05.664116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1057/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:06.031526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:06.033110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:06.086387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9951-e697-4002-a277-2378fe6f36cd None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:06.100646 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:06.102988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:06.103159 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:06.104585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] PATH_INFO: `/v3/projects/1e569cf58957469ba65e10db95cbb5f0` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:06.110039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e569cf58957469ba65e10db95cbb5f0)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:06.112356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:06.230169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e569cf58957469ba65e10db95cbb5f0', 'request_id': 'req-bc574590-b40d-4b73-9617-cdebcdf9fe38'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:06.236394 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e569cf58957469ba65e10db95cbb5f0', 'request_id': 'req-bc574590-b40d-4b73-9617-cdebcdf9fe38'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:06.245537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e569cf58957469ba65e10db95cbb5f0', 'request_id': 'req-bc574590-b40d-4b73-9617-cdebcdf9fe38'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:06.256666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] The token cache is being invalidate because project 1e569cf58957469ba65e10db95cbb5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:06.256950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:06.257564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bc574590-b40d-4b73-9617-cdebcdf9fe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:06.259054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1061/2118] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:06 2022] DELETE /identity/v3/projects/1e569cf58957469ba65e10db95cbb5f0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:08.672216 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:08.673639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:08.687792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef07d-8914-4942-a5b2-67ef627d0ae0 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:08.753454 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:08.754124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:08.754983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:08.755315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] PATH_INFO: `/v3/users/3c4b825bcfa44b60bcecd920fdcc4bba` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:08.756623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4b825bcfa44b60bcecd920fdcc4bba)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:08.758594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:08.789953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:08.809762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4b825bcfa44b60bcecd920fdcc4bba'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:08.816697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4b825bcfa44b60bcecd920fdcc4bba'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:08.818054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4b825bcfa44b60bcecd920fdcc4bba'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:08.825396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4b825bcfa44b60bcecd920fdcc4bba'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:08.826029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4b825bcfa44b60bcecd920fdcc4bba'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:08.843466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1058/2119] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:08 2022] DELETE /identity/v3/users/3c4b825bcfa44b60bcecd920fdcc4bba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:08.847879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:08.848791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:08.848791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:08.867253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:08.868449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:08.929659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1062/2120] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:08.939271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:08.940651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:08.998114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a477ab4-b5ae-4069-9024-166cc14af845 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:09.001782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:09.002391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:09.002671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:09.002945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:09.012603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:09.014033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:09.025449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1059/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:09.313274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:09.315739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:09.330333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1b78-a7d9-4c2d-a963-cd7df8cfe20d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:09.335744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:09.336449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:09.336789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:09.337129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] PATH_INFO: `/v3/projects/2f1807a86f314df09d99d78583e16aff` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:09.338400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1807a86f314df09d99d78583e16aff)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:09.340592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:09.385259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:09.389055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1807a86f314df09d99d78583e16aff', 'request_id': 'req-006994e0-d283-4ca7-a192-054eb1a23150'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.399651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1807a86f314df09d99d78583e16aff', 'request_id': 'req-006994e0-d283-4ca7-a192-054eb1a23150'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.407277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1807a86f314df09d99d78583e16aff', 'request_id': 'req-006994e0-d283-4ca7-a192-054eb1a23150'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.418267 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] The token cache is being invalidate because project 2f1807a86f314df09d99d78583e16aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:09.418577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.419192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-006994e0-d283-4ca7-a192-054eb1a23150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.420681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1063/2122] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:09 2022] DELETE /identity/v3/projects/2f1807a86f314df09d99d78583e16aff => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:04:09.424618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:09.434202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229fa3-a002-49ac-9406-5cfbaaa1fb42 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:09.507873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:09.508330 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:09.508745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:09.520857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:09.522296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:09.522583 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:09.522876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] PATH_INFO: `/v3/users/1e923af2f64044c58cc625843cccad66` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:09.524112 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e923af2f64044c58cc625843cccad66)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:09.526058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:09.533220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] MFA Rules not processed for user `e8b129ce64604e7d8154cecba20f3536`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:09.534437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:09.575572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e923af2f64044c58cc625843cccad66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.578497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:09.589102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e923af2f64044c58cc625843cccad66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.590167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e923af2f64044c58cc625843cccad66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.597691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e923af2f64044c58cc625843cccad66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.598814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1064/2123] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:04:09.598939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e923af2f64044c58cc625843cccad66'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:09.617046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1060/2124] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:09 2022] DELETE /identity/v3/users/1e923af2f64044c58cc625843cccad66 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:10.235619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:10.237985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:10.252321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930278-fd5d-4076-a934-6d872538b9e9 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:10.334777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:10.335914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:10.335914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:10.336133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] PATH_INFO: `/v3/projects/947e68779ad54dbe8260303eb4f2e3ea` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:10.337300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947e68779ad54dbe8260303eb4f2e3ea)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:10.339503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:10.397792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947e68779ad54dbe8260303eb4f2e3ea', 'request_id': 'req-d84ca859-238d-4b20-afb3-426455d96091'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.404012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947e68779ad54dbe8260303eb4f2e3ea', 'request_id': 'req-d84ca859-238d-4b20-afb3-426455d96091'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.413947 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947e68779ad54dbe8260303eb4f2e3ea', 'request_id': 'req-d84ca859-238d-4b20-afb3-426455d96091'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.440565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] The token cache is being invalidate because project 947e68779ad54dbe8260303eb4f2e3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:10.440854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.441548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.443322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1065/2125] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:10 2022] DELETE /identity/v3/projects/947e68779ad54dbe8260303eb4f2e3ea => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:10.446977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:10.448708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:10.463312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8531d-edb7-443c-bfe2-c25f6ef038ec admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:10.539686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:10.540598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:10.540995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:10.541477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] PATH_INFO: `/v3/users/1c4a9dbfd0124474b2f6cd2be3861288` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:10.542860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4a9dbfd0124474b2f6cd2be3861288)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:10.544786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:10.611247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4a9dbfd0124474b2f6cd2be3861288'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.619018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4a9dbfd0124474b2f6cd2be3861288'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.619710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4a9dbfd0124474b2f6cd2be3861288'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.628448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4a9dbfd0124474b2f6cd2be3861288'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.629126 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-57a8ddb5-611c-4f9d-b14b-92bebae1036b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4a9dbfd0124474b2f6cd2be3861288'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:10.649166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1061/2126] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:10 2022] DELETE /identity/v3/users/1c4a9dbfd0124474b2f6cd2be3861288 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:04:10.987340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:10.987340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:11.015586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca859-238d-4b20-afb3-426455d96091 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.033346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:11.107951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.108967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.109341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.109621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] PATH_INFO: `/v3/projects/27ad1535672549a194b79ac697f9635b` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.110799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ad1535672549a194b79ac697f9635b)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.112812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.217377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ad1535672549a194b79ac697f9635b', 'request_id': 'req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:11.227900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ad1535672549a194b79ac697f9635b', 'request_id': 'req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:11.252664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ad1535672549a194b79ac697f9635b', 'request_id': 'req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:11.275230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] The token cache is being invalidate because project 27ad1535672549a194b79ac697f9635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:11.275639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:11.276413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-33262e6d-9dcc-417e-83e2-084c7d9d8ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:11.278659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1066/2127] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:10 2022] DELETE /identity/v3/projects/27ad1535672549a194b79ac697f9635b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:11.283518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.283806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.284084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.309885 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:11.311468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:11.361572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:11.381506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1062/2128] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:11.389918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.390209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.390484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.411880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:11.413037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:11.421066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1067/2129] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:11.427095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.437596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6540-4c59-4f0a-a402-8bfb678873b0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.442711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.443413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.443699 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.444220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.444689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:04:11.445431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.446621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.459379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1063/2130] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:04:11.463729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.473034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f788-59a9-451c-bb5c-e6cc16b22929 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.478732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.479356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.479632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.479902 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.480536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.482479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.512848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1068/2131] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:04:11 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:11.514171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.525463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db79a8-7db4-4e80-877c-3a92114a4d29 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.588503 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.589436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.589717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.590013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.590689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.592597 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.617577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1064/2132] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:04:11 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:11.622007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.632526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ac5b-f2f0-4e78-a7ff-8d930b11444e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.637350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.638009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.638285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.638554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.639219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.640814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.652553 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1069/2133] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:11.657009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.668307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76773a-3ed4-495b-9725-53e85b171639 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.672899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ff9b-d45d-4b74-a758-14a7fb46e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.673494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ff9b-d45d-4b74-a758-14a7fb46e68a admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.673803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ff9b-d45d-4b74-a758-14a7fb46e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.674078 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ff9b-d45d-4b74-a758-14a7fb46e68a admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.674714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ff9b-d45d-4b74-a758-14a7fb46e68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.676786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ff9b-d45d-4b74-a758-14a7fb46e68a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.687312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1065/2134] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:11.691402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.701589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea2f79-b31d-4d05-929e-6ee9f35e119a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.706170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.706809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.707086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.707908 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] PATH_INFO: `/v3/projects/1e95aae17375428e8c6adab351603950/users/c7a1b7762cfb42bfa7bad1e6f9ccf4a3/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.722523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e95aae17375428e8c6adab351603950, user_id=c7a1b7762cfb42bfa7bad1e6f9ccf4a3, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.726537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:11.739844 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1070/2135] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:11 2022] PUT /identity/v3/projects/1e95aae17375428e8c6adab351603950/users/c7a1b7762cfb42bfa7bad1e6f9ccf4a3/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:11.811592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca851c4d-248c-4233-909c-a838d0af7b7e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.812326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca851c4d-248c-4233-909c-a838d0af7b7e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.812912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca851c4d-248c-4233-909c-a838d0af7b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.841702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ca851c4d-248c-4233-909c-a838d0af7b7e None None] MFA Rules not processed for user `c7a1b7762cfb42bfa7bad1e6f9ccf4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:11.842950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ca851c4d-248c-4233-909c-a838d0af7b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:11.905678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1066/2136] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:11.916868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:11.918753 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:11.953842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:11.984045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90352970-8fe9-4a0b-9155-327e126ad17f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:11.987557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1bac1-da52-44f3-846b-290630f7e721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:11.988180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1bac1-da52-44f3-846b-290630f7e721 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:11.988454 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1bac1-da52-44f3-846b-290630f7e721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:11.988717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1bac1-da52-44f3-846b-290630f7e721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:11.996977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1bac1-da52-44f3-846b-290630f7e721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:11.998422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1bac1-da52-44f3-846b-290630f7e721 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:12.007767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1071/2137] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:04:21.902850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:22.003073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=11 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:25.296247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:25.296747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:25.296843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:25.318595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] MFA Rules not processed for user `8ade50458d8041b28b85e3d1ab9a3eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:25.319817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:25.394414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1067/2138] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:26.313274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3a40-9159-4749-996a-559e3d4a60d2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:26.313713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3a40-9159-4749-996a-559e3d4a60d2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:26.313922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3a40-9159-4749-996a-559e3d4a60d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:26.338678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-877a3a40-9159-4749-996a-559e3d4a60d2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:26.339989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-877a3a40-9159-4749-996a-559e3d4a60d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:26.406911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1072/2139] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:26.423489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:26.424879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:26.502910 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6bb12-34ac-4bb2-af0b-0b12e6f3dcee None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:26.508248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:26.508843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:26.509118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:26.509384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:26.517863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:26.519486 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:26.530381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1068/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:30.350461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb788-fe08-4003-a87b-743ce8418e20 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:30.351042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb788-fe08-4003-a87b-743ce8418e20 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:30.351042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb788-fe08-4003-a87b-743ce8418e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:30.370281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-84ddb788-fe08-4003-a87b-743ce8418e20 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:30.371490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-84ddb788-fe08-4003-a87b-743ce8418e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:30.379361 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1073/2141] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:30.393890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:30.396635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:30.411745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece66634-0211-4824-9569-04d6dfeeb782 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:30.417475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17a9a7-5090-4550-b746-20804780636c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:30.418115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17a9a7-5090-4550-b746-20804780636c service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:30.418444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17a9a7-5090-4550-b746-20804780636c service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:30.418895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17a9a7-5090-4550-b746-20804780636c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:30.427921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17a9a7-5090-4550-b746-20804780636c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:30.429557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17a9a7-5090-4550-b746-20804780636c service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:30.439426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1069/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:33.664666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:33.665240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:33.665240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:33.685724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:33.687113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:33.740698 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:33.741269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:33.741269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:33.752880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1074/2143] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:33.763403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:33.764748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:33.773046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1070/2144] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:04:33.789768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:33.797107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:33.798460 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:33.804196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09558ee-dfb9-4c83-902a-1ff87eacb924 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:33.810143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e1ac-65e5-416e-a1f2-95e709cd1f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:33.810789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e1ac-65e5-416e-a1f2-95e709cd1f88 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:33.811066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e1ac-65e5-416e-a1f2-95e709cd1f88 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:33.811334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e1ac-65e5-416e-a1f2-95e709cd1f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:33.822272 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211e1ac-65e5-416e-a1f2-95e709cd1f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:33.824162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211e1ac-65e5-416e-a1f2-95e709cd1f88 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:33.839353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1075/2145] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:33.872592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd512e6-a086-4c65-81a4-fe8b7d2d3cd9 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:33.877831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:33.878459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:33.878737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:33.879039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:33.887690 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:33.889251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:33.893734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:33.898872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1071/2146] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 06:04:37.730977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d002db-615c-406a-b4e4-5d5a2fe0d1b9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:37.732301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d002db-615c-406a-b4e4-5d5a2fe0d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:37.733311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d002db-615c-406a-b4e4-5d5a2fe0d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:37.768064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-35d002db-615c-406a-b4e4-5d5a2fe0d1b9 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:37.769845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-35d002db-615c-406a-b4e4-5d5a2fe0d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:37.783848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1076/2147] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:37.803423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:37.830888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2fd45-f477-423c-b2b1-26fc7b37a24f service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:37.846489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:37.847181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:37.847518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:37.848031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:37.857939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:37.860364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:37.874143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1072/2148] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:41.935206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d252-5ba3-404e-b592-4a14a273398c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:41.935734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d252-5ba3-404e-b592-4a14a273398c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:41.935832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d252-5ba3-404e-b592-4a14a273398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:41.955957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3699d252-5ba3-404e-b592-4a14a273398c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:41.957175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3699d252-5ba3-404e-b592-4a14a273398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:41.969038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1077/2149] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:41.985084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:41.997953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1e8fb-1a34-4bff-8927-847cc3d505e6 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:42.003610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:42.004201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:42.004462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:42.004744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:42.013576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:42.015188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:42.024850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1073/2150] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:04:46.228767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:46.229364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:46.229364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:46.256710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:46.258789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:46.277190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1078/2151] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:46.307417 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:46.319321 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41b6b-4026-494d-bb56-268bc01cf8e5 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:46.325075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae982-0f81-47d5-a5fb-babaaf55285f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:46.325872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae982-0f81-47d5-a5fb-babaaf55285f service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:46.326172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae982-0f81-47d5-a5fb-babaaf55285f service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:46.326448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae982-0f81-47d5-a5fb-babaaf55285f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:46.335884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae982-0f81-47d5-a5fb-babaaf55285f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:46.337507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae982-0f81-47d5-a5fb-babaaf55285f service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:46.348007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1074/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:50.457468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:50.471804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1182cc-4463-440d-bcf1-373dce774748 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:50.477111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016626bd-d557-475b-9059-2366b757492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:50.478015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016626bd-d557-475b-9059-2366b757492a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:50.478296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016626bd-d557-475b-9059-2366b757492a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:50.478563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016626bd-d557-475b-9059-2366b757492a admin admin] PATH_INFO: `/v3/users/c7a1b7762cfb42bfa7bad1e6f9ccf4a3` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:50.479887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016626bd-d557-475b-9059-2366b757492a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a1b7762cfb42bfa7bad1e6f9ccf4a3)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:50.481845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016626bd-d557-475b-9059-2366b757492a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:50.546471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a1b7762cfb42bfa7bad1e6f9ccf4a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:50.547303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a1b7762cfb42bfa7bad1e6f9ccf4a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:50.556466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a1b7762cfb42bfa7bad1e6f9ccf4a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:50.557360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a1b7762cfb42bfa7bad1e6f9ccf4a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:50.561572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:50.572804 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a1b7762cfb42bfa7bad1e6f9ccf4a3'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:50.599444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1079/2153] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:50 2022] DELETE /identity/v3/users/c7a1b7762cfb42bfa7bad1e6f9ccf4a3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:04:50.603871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:50.604408 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:50.604743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:50.636716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:50.637967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:50.738715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1075/2154] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:04:50.750314 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:50.751678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:50.834847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016626bd-d557-475b-9059-2366b757492a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:50.839126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec5924-f450-4997-a093-dab6313c8550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:50.839827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec5924-f450-4997-a093-dab6313c8550 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:50.840203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec5924-f450-4997-a093-dab6313c8550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:50.840513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec5924-f450-4997-a093-dab6313c8550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:50.852268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec5924-f450-4997-a093-dab6313c8550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:50.853924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec5924-f450-4997-a093-dab6313c8550 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:50.872475 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1080/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:04:51.287707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:51.289361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:51.308108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbbec3-5b8b-4a2d-a3e6-3bb997b7ee76 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:51.319137 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:51.330558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.337648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.337648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] PATH_INFO: `/v3/projects/1e95aae17375428e8c6adab351603950` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.337648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e95aae17375428e8c6adab351603950)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:51.340849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:51.430559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e95aae17375428e8c6adab351603950', 'request_id': 'req-e3568999-65b5-4339-96e9-d7270b71db17'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:51.437206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e95aae17375428e8c6adab351603950', 'request_id': 'req-e3568999-65b5-4339-96e9-d7270b71db17'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:51.449502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e95aae17375428e8c6adab351603950', 'request_id': 'req-e3568999-65b5-4339-96e9-d7270b71db17'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:51.468446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] The token cache is being invalidate because project 1e95aae17375428e8c6adab351603950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:51.469079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:51.470779 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-e3568999-65b5-4339-96e9-d7270b71db17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:51.472804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1076/2156] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:51 2022] DELETE /identity/v3/projects/1e95aae17375428e8c6adab351603950 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:51.477767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.478874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.479354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.502880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:51.504269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:51.595068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1081/2157] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:51.596883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.597229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.597693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.620806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:51.623096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:51.637186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1077/2158] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:51.637968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:51.648187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae45f-da15-44ab-8e57-7f608d4fea92 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:51.653488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:51.654133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.654416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.654693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.655351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:04:51.655660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:51.657397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:51.673776 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1082/2159] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:04:51.675135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:51.688021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d796c-8c81-4d4b-b784-fb25c1b459e7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:51.693852 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:51.694850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.695196 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.695706 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.696441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:51.698587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:51.735319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1078/2160] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:04:51 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:04:51.736395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:51.748993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e683a6-bf92-42e2-8612-2cbf7e868b10 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:51.836790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:51.837463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.837675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.837971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.838925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:51.841435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:51.861039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:51.871819 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1083/2161] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:04:51 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:51.876180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:51.891838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffe6a9-d42b-4b24-8a99-eb21da23cb29 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:51.901866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:51.902665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.903083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.903365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.904268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:51.905939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:51.921901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1079/2162] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:51.923190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:51.936013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7dd19-e72f-416a-9118-baeeffbd112c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:51.943228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61418e-b4bd-48f3-850d-38ed36ebf1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:51.947104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61418e-b4bd-48f3-850d-38ed36ebf1ab admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:51.947774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61418e-b4bd-48f3-850d-38ed36ebf1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:51.948349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61418e-b4bd-48f3-850d-38ed36ebf1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:51.949011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61418e-b4bd-48f3-850d-38ed36ebf1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:51.950986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61418e-b4bd-48f3-850d-38ed36ebf1ab admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:51.974912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1084/2163] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:51.985367 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:52.006667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:52.018803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c5bb-70b8-4100-8c4b-230e0bc4c09d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:52.033707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:52.034523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:52.035011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:52.036081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] PATH_INFO: `/v3/projects/f62a685c8ca942b6918912a0873ffc30/users/8816c23959404386bec029dcef311a27/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:52.056696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62a685c8ca942b6918912a0873ffc30, user_id=8816c23959404386bec029dcef311a27, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:52.059926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:52.086210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1080/2164] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:51 2022] PUT /identity/v3/projects/f62a685c8ca942b6918912a0873ffc30/users/8816c23959404386bec029dcef311a27/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:52.098983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb04a0-c5ef-498f-8089-96333d0b771c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:52.099934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb04a0-c5ef-498f-8089-96333d0b771c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:52.100259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb04a0-c5ef-498f-8089-96333d0b771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:52.135396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-50bb04a0-c5ef-498f-8089-96333d0b771c None None] MFA Rules not processed for user `8816c23959404386bec029dcef311a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:52.137259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-50bb04a0-c5ef-498f-8089-96333d0b771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:52.233944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1085/2165] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:52.246790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:52.248835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:52.318977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261926e-876a-45d8-afef-5deac7cfbc0b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:52.325374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:52.326260 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:52.326540 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:52.326816 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:52.338830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:52.340761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:52.352903 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1081/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:04:56.682701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:56.683197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:56.683402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:56.703232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:56.704405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:56.763278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1086/2167] 10.222.0.16 () {58 vars in 967 bytes} [Thu Oct 20 06:04:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:56.776937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:56.778342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:56.850707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e319f-833c-4fae-9e50-a3e7c9741b37 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:56.855626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32861bfe-7b53-4c74-9d61-4c5da53f8c27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:56.856228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861bfe-7b53-4c74-9d61-4c5da53f8c27 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:56.856504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861bfe-7b53-4c74-9d61-4c5da53f8c27 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:56.856774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861bfe-7b53-4c74-9d61-4c5da53f8c27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:56.865067 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32861bfe-7b53-4c74-9d61-4c5da53f8c27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:56.866677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32861bfe-7b53-4c74-9d61-4c5da53f8c27 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:56.874900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1082/2168] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:04:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:04:57.558311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:57.618864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dbb1-03c4-4639-a22c-3f9ace73d8ca None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:57.623221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:57.623852 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:57.624110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:57.624378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] PATH_INFO: `/v3/users/8816c23959404386bec029dcef311a27` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:57.625465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8816c23959404386bec029dcef311a27)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:57.627407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:57.650054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:57.675059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8816c23959404386bec029dcef311a27'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:57.675692 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8816c23959404386bec029dcef311a27'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:57.683257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8816c23959404386bec029dcef311a27'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:57.683880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8816c23959404386bec029dcef311a27'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:57.691142 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8816c23959404386bec029dcef311a27'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:57.708219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1087/2169] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:57 2022] DELETE /identity/v3/users/8816c23959404386bec029dcef311a27 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:57.712750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:57.713034 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:57.713308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:57.732370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:57.733682 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:57.791285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1083/2170] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:57.800784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:57.803038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:57.859469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01162-2c81-4dd0-955a-aebb0ea2c166 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:57.863058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:57.863653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:57.863927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:57.864574 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:57.872858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:57.874317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:57.883412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1088/2171] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:04:58.345714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:58.347389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:58.360045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e6c4-9e83-4a89-951d-73c0f1b85561 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:58.365150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:58.365922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:58.366272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:58.367209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] PATH_INFO: `/v3/projects/f62a685c8ca942b6918912a0873ffc30` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:58.367948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62a685c8ca942b6918912a0873ffc30)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:58.370801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:58.390605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:58.441322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62a685c8ca942b6918912a0873ffc30', 'request_id': 'req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:58.448765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62a685c8ca942b6918912a0873ffc30', 'request_id': 'req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:58.459269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62a685c8ca942b6918912a0873ffc30', 'request_id': 'req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:58.487027 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] The token cache is being invalidate because project f62a685c8ca942b6918912a0873ffc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:58.487327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:58.490063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:58.492011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1084/2172] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:58 2022] DELETE /identity/v3/projects/f62a685c8ca942b6918912a0873ffc30 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:58.948469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:58.949974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:58.965537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100839bc-ba41-4937-a784-17233f691d98 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.026489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.027231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.027517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.027789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] PATH_INFO: `/v3/users/e8b129ce64604e7d8154cecba20f3536` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.028934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b129ce64604e7d8154cecba20f3536)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.030863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.075347 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:59.077006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b129ce64604e7d8154cecba20f3536'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.077680 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b129ce64604e7d8154cecba20f3536'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.086439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b129ce64604e7d8154cecba20f3536'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.087318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b129ce64604e7d8154cecba20f3536'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.096399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1c6c44df-3931-434c-8fa2-07063b1719f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b129ce64604e7d8154cecba20f3536'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.114855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1089/2173] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:04:58 2022] DELETE /identity/v3/users/e8b129ce64604e7d8154cecba20f3536 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:59.312859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.314457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:59.327427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f5acc-cf87-40f0-b25c-c3ad36a4da5d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.388144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.388695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.388976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.389247 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] PATH_INFO: `/v3/projects/fa3af570b0af4abe913bfc4ddf1e5873` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.390428 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3af570b0af4abe913bfc4ddf1e5873)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.392312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.443256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3af570b0af4abe913bfc4ddf1e5873', 'request_id': 'req-1a52f4b8-beb7-45b1-be08-d89392bb249e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.449472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3af570b0af4abe913bfc4ddf1e5873', 'request_id': 'req-1a52f4b8-beb7-45b1-be08-d89392bb249e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.457523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3af570b0af4abe913bfc4ddf1e5873', 'request_id': 'req-1a52f4b8-beb7-45b1-be08-d89392bb249e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.469329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] The token cache is being invalidate because project fa3af570b0af4abe913bfc4ddf1e5873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:04:59.469621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.470431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1a52f4b8-beb7-45b1-be08-d89392bb249e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:04:59.471960 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1085/2174] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:04:59 2022] DELETE /identity/v3/projects/fa3af570b0af4abe913bfc4ddf1e5873 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:04:59.478434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.478825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.479169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.500703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:59.502211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:59.564084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1090/2175] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:04:59.572444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.572724 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.572996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.592622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:59.593841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:59.601665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1086/2176] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:04:59.606421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.616846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb09e7-7a93-4c01-9fa4-5138194657b3 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.621333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.621948 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.622227 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.622499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.623144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:04:59.623446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.625049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.637132 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1091/2177] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:04:59.641307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.650394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d518-3d2b-497a-9f98-fe3234c9717d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.655014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.655611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.655893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.656168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.656808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.658800 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.679894 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:59.688859 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1087/2178] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:04:59.693540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.703558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d5ca-dd77-41ac-a598-ee8cec7eeee4 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.759860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.760458 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.760734 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.761248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.761904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.763795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.783635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1092/2179] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:04:59 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:04:59.788420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.798462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d7f56-5eb1-4c81-83bc-9e1c991ea495 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.804208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.804964 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.805143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.805424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.806127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.807745 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.818643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1088/2180] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:59.822772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.834841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eacc58-1b96-41d5-ac8f-798a3964ef69 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.839875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589635-d3cd-4df4-8b06-41f9d51b5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.840783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589635-d3cd-4df4-8b06-41f9d51b5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.840783 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589635-d3cd-4df4-8b06-41f9d51b5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.841058 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589635-d3cd-4df4-8b06-41f9d51b5c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.841817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a589635-d3cd-4df4-8b06-41f9d51b5c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.843700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a589635-d3cd-4df4-8b06-41f9d51b5c06 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.856582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1093/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:04:59.860668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:04:59.872951 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9087a84-e080-4416-a40f-a97a82516fd0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:04:59.877636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:04:59.878320 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.878598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.878869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] PATH_INFO: `/v3/projects/bae435faf8024e998996ab6d51b1f559/users/875e20a6dfae4e5d8849ded56b4654ac/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.895071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae435faf8024e998996ab6d51b1f559, user_id=875e20a6dfae4e5d8849ded56b4654ac, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:04:59.898370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:04:59.912085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1089/2182] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:04:59 2022] PUT /identity/v3/projects/bae435faf8024e998996ab6d51b1f559/users/875e20a6dfae4e5d8849ded56b4654ac/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:04:59.917105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737c97-5aea-4b3a-8a2c-fa8586db2891 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:04:59.917483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737c97-5aea-4b3a-8a2c-fa8586db2891 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:04:59.917863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737c97-5aea-4b3a-8a2c-fa8586db2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:04:59.937552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f8737c97-5aea-4b3a-8a2c-fa8586db2891 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:04:59.938779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f8737c97-5aea-4b3a-8a2c-fa8586db2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:04:59.966332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:00.009617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1094/2183] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:00.019294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:00.021531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:00.078686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee502-5c7c-4fdc-8445-3aa339a2ebb9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:00.082307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32b8f-72a3-466d-b48a-2207151ec3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:00.082940 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32b8f-72a3-466d-b48a-2207151ec3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:00.083217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32b8f-72a3-466d-b48a-2207151ec3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:00.083490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32b8f-72a3-466d-b48a-2207151ec3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:00.093221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e32b8f-72a3-466d-b48a-2207151ec3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:00.094664 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e32b8f-72a3-466d-b48a-2207151ec3cd service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:00.104147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1090/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:04.119846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.120404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.121110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.173773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] MFA Rules not processed for user `77436462fe634c5f89d1e44b9b5ea1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:04.176210 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:04.180036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1132-c736-492e-8cec-6e920142852b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.180544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1132-c736-492e-8cec-6e920142852b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.180710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1132-c736-492e-8cec-6e920142852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.217353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-bdac1132-c736-492e-8cec-6e920142852b None None] MFA Rules not processed for user `875e20a6dfae4e5d8849ded56b4654ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:04.218868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bdac1132-c736-492e-8cec-6e920142852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:04.260291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1095/2185] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:04.304973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1091/2186] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:04.309570 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:04.327573 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffa70e-7b08-4620-98d3-a9e104a3212b None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:04.332315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:04.332999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.333274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.333663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.334504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:04.336431 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:04.373861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1096/2187] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:05:04 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:05:04.377308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1132-c736-492e-8cec-6e920142852b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:04.391483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1132-c736-492e-8cec-6e920142852b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:04.466572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:04.477445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:04.478713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.478878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.479713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.480469 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:04.482553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:04.511893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1092/2188] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:05:04 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:05:04.516759 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:04.528549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e12ed-ba16-4532-a09b-6f908024e9f9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:04.533591 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:04.534450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.534724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.534996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.536255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:04.537922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:04.548655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1097/2189] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:05:04.553612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:04.565311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a6c4-7c4b-486c-9e82-75c7a03ed497 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:04.574882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:04.575162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.575436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.575707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] PATH_INFO: `/v3/projects/6a3583154f474084afe39a6165a33042/users/04b8fd3626a54356946b3f8b705797b5/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.597115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3583154f474084afe39a6165a33042, user_id=04b8fd3626a54356946b3f8b705797b5, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:04.603948 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:04.624484 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1093/2190] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:05:04 2022] PUT /identity/v3/projects/6a3583154f474084afe39a6165a33042/users/04b8fd3626a54356946b3f8b705797b5/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:05:04.631635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:04.653962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb030d-3f4f-40ed-9193-948005229a1f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:04.736303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c286b-bd5c-443e-a31f-101126f058a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:04.737067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c286b-bd5c-443e-a31f-101126f058a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.737438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c286b-bd5c-443e-a31f-101126f058a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.738074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c286b-bd5c-443e-a31f-101126f058a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.738782 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c286b-bd5c-443e-a31f-101126f058a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:04.740489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c286b-bd5c-443e-a31f-101126f058a5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:04.753856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1098/2191] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:05:04.758472 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:04.769534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101d40f-0457-45e9-a1fd-2dd62908229e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:04.776766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:04.777488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:04.777799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:04.778081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] PATH_INFO: `/v3/projects/6a3583154f474084afe39a6165a33042/users/04b8fd3626a54356946b3f8b705797b5/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:04.780087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3583154f474084afe39a6165a33042, user_id=04b8fd3626a54356946b3f8b705797b5, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:04.783182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:04.795591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1094/2192] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:05:04 2022] PUT /identity/v3/projects/6a3583154f474084afe39a6165a33042/users/04b8fd3626a54356946b3f8b705797b5/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:05:11.653592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25033b2-193d-49d6-a76c-a1049dfcc723 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:11.654194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25033b2-193d-49d6-a76c-a1049dfcc723 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:11.654616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25033b2-193d-49d6-a76c-a1049dfcc723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:11.693415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d25033b2-193d-49d6-a76c-a1049dfcc723 None None] MFA Rules not processed for user `04b8fd3626a54356946b3f8b705797b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:11.695028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d25033b2-193d-49d6-a76c-a1049dfcc723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:11.726897 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:11.782035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1099/2193] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:05:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:11.791754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:11.794210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:11.878107 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da7e3-4c31-46e6-b876-4c1d463da57f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:11.882600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:11.883380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:11.883659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:11.884068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:11.965413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:11.967072 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:11.978674 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1095/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:12.172328 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:12.175741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:12.176305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:12.196642 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:12.197968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:12.280728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1100/2195] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:05:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:12.296834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:12.298412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:12.399240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:12.404787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ff420-56a2-403f-ab47-b342b3789f6c service glance] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:12.413482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc885-82a4-4301-a8b4-1c9aa8736ff3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:12.414336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc885-82a4-4301-a8b4-1c9aa8736ff3 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:12.414626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc885-82a4-4301-a8b4-1c9aa8736ff3 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:12.414936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc885-82a4-4301-a8b4-1c9aa8736ff3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:12.433389 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc885-82a4-4301-a8b4-1c9aa8736ff3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:12.435085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc885-82a4-4301-a8b4-1c9aa8736ff3 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:12.446479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1096/2196] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:05:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:13.067687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:13.069407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:13.161554 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:13.162235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:13.162235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:13.186318 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:13.188342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:13.197432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1097/2197] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:05:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:13.218458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:13.225581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32dce-ad30-462b-837d-c7df37761030 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:13.239999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:13.240873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:13.241298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:13.241799 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:13.245634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd821a-ed9e-4659-9866-d03b83849d58 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:13.246660 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:13.260367 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:13.261498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:13.262338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:13.262809 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:13.278256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:13.278256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73196263-34db-40a3-a7fa-170e80d87c15 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:13.289062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:13.291083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:13.303334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1101/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:13.306176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1098/2199] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:05:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:22.652480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8d293-61a4-4b09-899c-6bc0a939eb77 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:22.653121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8d293-61a4-4b09-899c-6bc0a939eb77 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:22.653121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8d293-61a4-4b09-899c-6bc0a939eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:22.686867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0ca8d293-61a4-4b09-899c-6bc0a939eb77 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:22.690386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0ca8d293-61a4-4b09-899c-6bc0a939eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:22.756477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:22.768168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1102/2200] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:05:22.783694 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:22.785914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:22.879197 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750c765-ae8c-4c0d-b3cd-37a8f74d7a76 service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:22.886363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99196-fcf7-456e-bad1-74dd644f6749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:22.887109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99196-fcf7-456e-bad1-74dd644f6749 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:22.887566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99196-fcf7-456e-bad1-74dd644f6749 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:22.888257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99196-fcf7-456e-bad1-74dd644f6749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:22.899749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99196-fcf7-456e-bad1-74dd644f6749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:22.904380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99196-fcf7-456e-bad1-74dd644f6749 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:22.930115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1099/2201] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:25.751165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:25.751758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:25.751758 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:25.783286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] MFA Rules not processed for user `875e20a6dfae4e5d8849ded56b4654ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:25.786707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:25.795206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1103/2202] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:05:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:26.057792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a83b-3419-4610-bc32-e0e21b31c0e7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:26.058248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a83b-3419-4610-bc32-e0e21b31c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:26.058439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a83b-3419-4610-bc32-e0e21b31c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:26.083080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8ed8a83b-3419-4610-bc32-e0e21b31c0e7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:26.084741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8ed8a83b-3419-4610-bc32-e0e21b31c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:26.094953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1100/2203] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:26.109332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:26.125103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61f468-2b3c-4947-94d7-84c374a46f03 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:26.130949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:26.131650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:26.131926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:26.132192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:26.143725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:26.145917 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:26.157046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1104/2204] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:28.957091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5ee50-e79b-4dda-b224-d3f24240ed29 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:28.957966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5ee50-e79b-4dda-b224-d3f24240ed29 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:28.958255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5ee50-e79b-4dda-b224-d3f24240ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:28.990881 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2df5ee50-e79b-4dda-b224-d3f24240ed29 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:28.992223 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2df5ee50-e79b-4dda-b224-d3f24240ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:29.000677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1101/2205] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:05:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:05:29.016859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:29.029886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fe076-5799-497c-96d2-20ff08c87506 service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:29.036505 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:29.037312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:29.037933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:29.038474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:29.048007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:29.050052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:29.060765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1105/2206] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:29.102380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106a4b-42ef-4396-a5ae-23c97c481665 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:29.102872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106a4b-42ef-4396-a5ae-23c97c481665 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:29.103313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106a4b-42ef-4396-a5ae-23c97c481665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:29.127750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-99106a4b-42ef-4396-a5ae-23c97c481665 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:29.129872 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-99106a4b-42ef-4396-a5ae-23c97c481665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:29.141255 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1102/2207] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:05:29.158295 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:29.160781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:29.210353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af06c-cd08-4e06-a787-047d5c875355 service swift] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:29.217605 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d17f9-5491-403f-98a1-a2da93d32d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:29.218304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d17f9-5491-403f-98a1-a2da93d32d56 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:29.219080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d17f9-5491-403f-98a1-a2da93d32d56 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:29.219080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d17f9-5491-403f-98a1-a2da93d32d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:29.230839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d17f9-5491-403f-98a1-a2da93d32d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:29.233586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d17f9-5491-403f-98a1-a2da93d32d56 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:29.251490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1106/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:39.121906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=56 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:39.243893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=22 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:41.339488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5a076-6677-4911-a96d-6019d425a70d None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.340059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5a076-6677-4911-a96d-6019d425a70d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.340059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5a076-6677-4911-a96d-6019d425a70d None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.341407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1103/2209] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 06:05:41.347153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610c3c-e455-42a1-8548-2f9578938d64 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.347649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610c3c-e455-42a1-8548-2f9578938d64 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.347750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610c3c-e455-42a1-8548-2f9578938d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.367836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f1610c3c-e455-42a1-8548-2f9578938d64 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:41.369041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f1610c3c-e455-42a1-8548-2f9578938d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:41.378677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1107/2210] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:05:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:41.390611 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5a076-6677-4911-a96d-6019d425a70d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:41.392258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8db5a076-6677-4911-a96d-6019d425a70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:41.405519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5a076-6677-4911-a96d-6019d425a70d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:41.409453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d4a5f-f832-464f-9ff5-606dc4f384fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:41.410278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4a5f-f832-464f-9ff5-606dc4f384fe service glance] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.410564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4a5f-f832-464f-9ff5-606dc4f384fe service glance] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.410844 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4a5f-f832-464f-9ff5-606dc4f384fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.421185 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d4a5f-f832-464f-9ff5-606dc4f384fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:41.422643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d4a5f-f832-464f-9ff5-606dc4f384fe service glance] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:41.434114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1104/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:41.506171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33fbd-5bd1-4a29-8474-453bd4326678 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.506455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33fbd-5bd1-4a29-8474-453bd4326678 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.506784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33fbd-5bd1-4a29-8474-453bd4326678 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.508114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1108/2212] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:05:41.513124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e1e4-5f20-445b-98fd-5916c79b13c2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.513412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e1e4-5f20-445b-98fd-5916c79b13c2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.513691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e1e4-5f20-445b-98fd-5916c79b13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.533915 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2a30e1e4-5f20-445b-98fd-5916c79b13c2 None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:41.535707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2a30e1e4-5f20-445b-98fd-5916c79b13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:41.586065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1105/2213] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:05:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:41.598251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33fbd-5bd1-4a29-8474-453bd4326678 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:41.599887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1fe33fbd-5bd1-4a29-8474-453bd4326678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:41.612668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33fbd-5bd1-4a29-8474-453bd4326678 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:41.616116 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162576c2-73e9-4b55-8ab5-c9a38c6276c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:41.616696 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162576c2-73e9-4b55-8ab5-c9a38c6276c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.616968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162576c2-73e9-4b55-8ab5-c9a38c6276c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.617235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162576c2-73e9-4b55-8ab5-c9a38c6276c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.624146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162576c2-73e9-4b55-8ab5-c9a38c6276c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:41.625572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162576c2-73e9-4b55-8ab5-c9a38c6276c6 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:41.633567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1109/2214] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:05:41.716627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed5589-082e-4c4e-971f-a6410eec3759 None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.717030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed5589-082e-4c4e-971f-a6410eec3759 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.717429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed5589-082e-4c4e-971f-a6410eec3759 None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.718908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1106/2215] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:05:41.725268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff03d-f112-4f58-b789-4c50acaa5a95 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.725547 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff03d-f112-4f58-b789-4c50acaa5a95 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.725843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff03d-f112-4f58-b789-4c50acaa5a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.748599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b1cff03d-f112-4f58-b789-4c50acaa5a95 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:41.749824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b1cff03d-f112-4f58-b789-4c50acaa5a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:41.759957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1110/2216] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:05:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:41.773177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed5589-082e-4c4e-971f-a6410eec3759 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:41.787023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed5589-082e-4c4e-971f-a6410eec3759 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:41.796712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:41.797356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:41.797638 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:41.797939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:41.814759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:41.816981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:41.828138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1107/2217] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:43.630388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accd1e0-52c1-4676-b308-8752410e63ee None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:43.630941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accd1e0-52c1-4676-b308-8752410e63ee None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:43.630941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accd1e0-52c1-4676-b308-8752410e63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:43.654513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7accd1e0-52c1-4676-b308-8752410e63ee None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:43.655967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7accd1e0-52c1-4676-b308-8752410e63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:43.664732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1111/2218] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:43.680493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:43.693633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bac94-73f0-4429-b91b-11eea36a3897 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:43.700378 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:43.700834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:43.701113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:43.701386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:43.711205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:43.712817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:43.724973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1108/2219] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:46.554681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc637-fc7e-4068-9d98-67ae37f3e262 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:46.555211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc637-fc7e-4068-9d98-67ae37f3e262 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:46.555316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc637-fc7e-4068-9d98-67ae37f3e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:46.574771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0a9bc637-fc7e-4068-9d98-67ae37f3e262 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:46.575994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0a9bc637-fc7e-4068-9d98-67ae37f3e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:46.583982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1112/2220] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:05:46.606450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:46.620094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2966c6-8b8b-488a-81c8-4578a1273734 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:46.624926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:46.625524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:46.625848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:46.626118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:46.634836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:46.636653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:46.644610 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1109/2221] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:05:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:46.886685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8cc1-2b2a-4a0d-a8e6-066dd28595fd None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:46.886963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8cc1-2b2a-4a0d-a8e6-066dd28595fd None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:46.887225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8cc1-2b2a-4a0d-a8e6-066dd28595fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:46.928225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cbab8cc1-2b2a-4a0d-a8e6-066dd28595fd None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:05:46.930462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cbab8cc1-2b2a-4a0d-a8e6-066dd28595fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:05:46.970754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1113/2222] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Oct 20 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:05:47.001665 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:05:47.023756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dde83-342d-4014-88fa-11df6f147cd8 service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:05:47.030355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:05:47.031401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:05:47.031878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:05:47.032350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:05:47.043182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:05:47.051313 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:05:47.063548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1110/2223] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:05:56.913051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=21 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:57.058048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=53 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:02.377303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:02.377826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:02.377926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:02.400014 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:06:02.401212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:06:02.408754 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1114/2224] 10.222.0.16 () {58 vars in 967 bytes} [Thu Oct 20 06:06:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:06:02.421434 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:06:02.433207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9bb4-ffa8-4805-b56b-854de10b4862 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:06:02.438327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ace8f-f50a-443e-88a3-0464b2f9b937 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:06:02.438937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ace8f-f50a-443e-88a3-0464b2f9b937 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:02.439220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ace8f-f50a-443e-88a3-0464b2f9b937 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:02.439498 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ace8f-f50a-443e-88a3-0464b2f9b937 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:02.450847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ace8f-f50a-443e-88a3-0464b2f9b937 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:06:02.452407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ace8f-f50a-443e-88a3-0464b2f9b937 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:06:02.461280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1111/2225] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:06:11.067318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:06:11.079296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e2c36-d3e7-4752-b36e-738dc8c0bff2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:06:11.086525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159607ed-b71d-44d3-b7d9-98570599e03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:06:11.087487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159607ed-b71d-44d3-b7d9-98570599e03b service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:11.088073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159607ed-b71d-44d3-b7d9-98570599e03b service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:11.088440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159607ed-b71d-44d3-b7d9-98570599e03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:11.099190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159607ed-b71d-44d3-b7d9-98570599e03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:06:11.100739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159607ed-b71d-44d3-b7d9-98570599e03b service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:06:11.111441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1115/2226] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:06:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:06:11.242098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:11.242937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:11.243263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:11.263326 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] MFA Rules not processed for user `8ade50458d8041b28b85e3d1ab9a3eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:06:11.264515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:06:11.323404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1112/2227] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:06:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:06:21.106273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=9 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:21.313892 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=31 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:30.233153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763535-c732-4c99-9906-7120265016be None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:30.233679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763535-c732-4c99-9906-7120265016be None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:30.233679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763535-c732-4c99-9906-7120265016be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:30.252718 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-34763535-c732-4c99-9906-7120265016be None None] MFA Rules not processed for user `ed2a06712005416ba12560278b0adc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:06:30.253941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-34763535-c732-4c99-9906-7120265016be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:06:30.310874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1116/2228] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:06:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:06:31.261314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:06:31.262830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:06:31.284592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ea71-c9e4-442d-b69e-bd273a5df33f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:06:31.290596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:06:31.291336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:31.291634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:31.292016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] PATH_INFO: `/v3/users/77436462fe634c5f89d1e44b9b5ea1dc` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:31.293282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77436462fe634c5f89d1e44b9b5ea1dc)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:06:31.295934 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:06:31.346153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77436462fe634c5f89d1e44b9b5ea1dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.353871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77436462fe634c5f89d1e44b9b5ea1dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.354546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77436462fe634c5f89d1e44b9b5ea1dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.362777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77436462fe634c5f89d1e44b9b5ea1dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.363478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4e87bae3-f4b4-46bb-be3d-a22e4ba36508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77436462fe634c5f89d1e44b9b5ea1dc'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.385905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1113/2229] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:06:31 2022] DELETE /identity/v3/users/77436462fe634c5f89d1e44b9b5ea1dc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:06:31.566243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34763535-c732-4c99-9906-7120265016be None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:06:31.578047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34763535-c732-4c99-9906-7120265016be None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:06:31.637200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:06:31.637881 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:31.638164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:31.638437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] PATH_INFO: `/v3/projects/952f1d1277ec421ea564b51a84571cfa` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:31.639700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=952f1d1277ec421ea564b51a84571cfa)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:06:31.641633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:06:31.690225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952f1d1277ec421ea564b51a84571cfa', 'request_id': 'req-c825734c-9f4b-49ce-a347-253ae213a02e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.696404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952f1d1277ec421ea564b51a84571cfa', 'request_id': 'req-c825734c-9f4b-49ce-a347-253ae213a02e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.704046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952f1d1277ec421ea564b51a84571cfa', 'request_id': 'req-c825734c-9f4b-49ce-a347-253ae213a02e'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.715283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] The token cache is being invalidate because project 952f1d1277ec421ea564b51a84571cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:06:31.715568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.716203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:06:31.717695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1117/2230] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:06:31 2022] DELETE /identity/v3/projects/952f1d1277ec421ea564b51a84571cfa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:06:41.381410 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:41.712227 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:52.691931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:06:52.692397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:06:52.692647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:06:52.712276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] MFA Rules not processed for user `6b53b2fbfb31429387e68f47f2650403`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:06:52.713455 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:06:52.767768 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1114/2231] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:06:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:02.761278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=25 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:04.060742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:04.062291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:04.118022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825734c-9f4b-49ce-a347-253ae213a02e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:04.121526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:04.122157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:04.122433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:04.122698 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:04.124354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:04.195045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:04.196496 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:04.199266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:04.200675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:04.207662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1118/2232] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:04.213451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dd71b-65af-401a-b0a4-2f0d2717eb79 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:04.216958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:04.217562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:04.217875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:04.218152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:04.219834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:04.234693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:04.236145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:04.248413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1115/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:07:14.202742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=54 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:14.244038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=6 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:17.419291 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:17.427870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8490a1-4925-4d49-9d6c-7fe860121bee service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:17.432571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:17.433165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:17.433441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:17.433711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:17.435447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:17.499158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:17.500602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28700739-0a87-4f05-bb51-9ff87812fe34 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:17.511657 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1119/2234] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:19.019650 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:19.021381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:19.035817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746ac5-f61f-414e-b831-57dc84b9b2f0 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:19.041926 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:19.042704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:19.043054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:19.043532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:19.045370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:19.142513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:19.144899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f33dc-9f24-43df-be2d-146fbe33b656 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:19.157396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1116/2235] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:20.943815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36cd5-f090-40a5-b7bd-6ae4ee2781b2 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:20.944540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36cd5-f090-40a5-b7bd-6ae4ee2781b2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:20.944771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36cd5-f090-40a5-b7bd-6ae4ee2781b2 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:20.947414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1120/2236] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 06:07:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:07:20.952497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:20.952966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:20.953187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:20.977288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] MFA Rules not processed for user `d277333a752f4bfea444af9ed1a7a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:20.978949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:21.029423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36cd5-f090-40a5-b7bd-6ae4ee2781b2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.031471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8ba36cd5-f090-40a5-b7bd-6ae4ee2781b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:21.049969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36cd5-f090-40a5-b7bd-6ae4ee2781b2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.055620 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.056569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.057090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.057588 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] PATH_INFO: `/v3/users/8ade50458d8041b28b85e3d1ab9a3eb7` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.059084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ade50458d8041b28b85e3d1ab9a3eb7)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.061343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.070212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1117/2237] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 06:07:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:21.082433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.096634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3c3d5-cf43-47bc-9737-3b98c84f032f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.103080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.103695 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.104098 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.104531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.106923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:21.125079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ade50458d8041b28b85e3d1ab9a3eb7'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.126100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ade50458d8041b28b85e3d1ab9a3eb7'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.136724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ade50458d8041b28b85e3d1ab9a3eb7'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.137448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ade50458d8041b28b85e3d1ab9a3eb7'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.138620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.140547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.146901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a7832a57-ca12-4410-a826-ea4d99e6ac17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ade50458d8041b28b85e3d1ab9a3eb7'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.156992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1118/2238] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:21.174151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1121/2239] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:21 2022] DELETE /identity/v3/users/8ade50458d8041b28b85e3d1ab9a3eb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:21.361955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.381030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5be27-e7b3-4d32-8b88-a801419db61d service placement] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.452784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.453437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.453715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.454013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] PATH_INFO: `/v3/projects/b8337983037f49479dc679c1091b61f9` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.455146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8337983037f49479dc679c1091b61f9)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.457054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.488165 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:21.512708 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8337983037f49479dc679c1091b61f9', 'request_id': 'req-675e60a2-97e1-4311-9883-c4f0db7aaa39'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.518817 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8337983037f49479dc679c1091b61f9', 'request_id': 'req-675e60a2-97e1-4311-9883-c4f0db7aaa39'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.526532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8337983037f49479dc679c1091b61f9', 'request_id': 'req-675e60a2-97e1-4311-9883-c4f0db7aaa39'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.539333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] The token cache is being invalidate because project b8337983037f49479dc679c1091b61f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:21.539739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.540365 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-675e60a2-97e1-4311-9883-c4f0db7aaa39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:21.541899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1119/2240] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:21 2022] DELETE /identity/v3/projects/b8337983037f49479dc679c1091b61f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:21.546987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.547274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.547553 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.568147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:21.569439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:21.626714 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1122/2241] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:21.635013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.635299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.635573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.656832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:21.658058 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:21.666362 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1120/2242] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:21.670672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.681056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27f980-1bdf-4407-9a7e-027e020e6140 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.685403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.686028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.686302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.686567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.687252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:21.687545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.689117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.690530 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:21.702364 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1123/2243] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:07:21.706393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.716001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83947316-cd3b-4bc6-b3fa-bf2b32d70449 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.720614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.721209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.721486 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.721783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.722414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.724299 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.751530 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1121/2244] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:21.755801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.765845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487e049-ccaf-42c2-a4b2-2005ae7b8a0b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.824488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.825138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.825435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.825710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.826524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.828487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.852625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1124/2245] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:21 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:21.854132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.864242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b3544-0a58-49ac-9dc0-baf1d27d7b87 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.869273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.869906 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.870180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.870445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.871080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.872639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.883214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1122/2246] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:21.887434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.897980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0d68-7c9c-467e-8229-ed499129f622 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.902572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584b562-6dee-4356-87e9-04d0f6bab473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.903161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584b562-6dee-4356-87e9-04d0f6bab473 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.903438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584b562-6dee-4356-87e9-04d0f6bab473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.903708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584b562-6dee-4356-87e9-04d0f6bab473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.904373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584b562-6dee-4356-87e9-04d0f6bab473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.905989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584b562-6dee-4356-87e9-04d0f6bab473 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.916930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1125/2247] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:21.920959 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:21.930863 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364ae2d-e0bf-404b-91d8-c51f34b5b255 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:21.935609 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:21.936246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.936528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.936803 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] PATH_INFO: `/v3/projects/d355d071519841ab878f73de2527b39d/users/cf3c86d48cea4f9d818448a6b355d4ce/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:21.951549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d355d071519841ab878f73de2527b39d, user_id=cf3c86d48cea4f9d818448a6b355d4ce, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:21.954256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:21.967878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1123/2248] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:21 2022] PUT /identity/v3/projects/d355d071519841ab878f73de2527b39d/users/cf3c86d48cea4f9d818448a6b355d4ce/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:21.980037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:21.980552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:21.980552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:22.007863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] MFA Rules not processed for user `cf3c86d48cea4f9d818448a6b355d4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:22.009049 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:22.072136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1126/2249] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:22.083395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:22.085686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:22.157125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dbbbb-2f8b-4c51-824a-c66481d1379d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:22.162736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca780-72ba-485d-b657-7d3f190f51b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:22.163361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca780-72ba-485d-b657-7d3f190f51b3 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:22.163639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca780-72ba-485d-b657-7d3f190f51b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:22.163939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca780-72ba-485d-b657-7d3f190f51b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:22.171758 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca780-72ba-485d-b657-7d3f190f51b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:22.173327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca780-72ba-485d-b657-7d3f190f51b3 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:22.182457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1124/2250] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:22.405997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:22.468106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959e7f-0236-41aa-85a5-ae8dc57983c2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:22.472546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:22.473173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:22.473448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:22.473719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] PATH_INFO: `/v3/users/cf3c86d48cea4f9d818448a6b355d4ce` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:22.474865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3c86d48cea4f9d818448a6b355d4ce)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:22.476777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:22.479111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:22.524536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3c86d48cea4f9d818448a6b355d4ce'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:22.525190 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3c86d48cea4f9d818448a6b355d4ce'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:22.532123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3c86d48cea4f9d818448a6b355d4ce'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:22.532750 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3c86d48cea4f9d818448a6b355d4ce'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:22.539382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3c86d48cea4f9d818448a6b355d4ce'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:22.557013 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1127/2251] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:22 2022] DELETE /identity/v3/users/cf3c86d48cea4f9d818448a6b355d4ce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:22.561555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:22.561875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:22.562153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:22.581627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:22.582855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:22.610770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:22.643002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1125/2252] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:22.652649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:22.654073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:22.710229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c9db-bfaa-4300-8ef8-b8e05baf87a2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:22.714119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b687315-4373-4847-889a-e52a6000f792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:22.714720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687315-4373-4847-889a-e52a6000f792 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:22.715002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687315-4373-4847-889a-e52a6000f792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:22.715271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687315-4373-4847-889a-e52a6000f792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:22.724396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b687315-4373-4847-889a-e52a6000f792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:22.725942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b687315-4373-4847-889a-e52a6000f792 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:22.735407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1128/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:22.999865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.001282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:23.015253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343bac-4b61-4fe1-bff0-d5100ba8df05 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.019774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.020406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.021105 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.021537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] PATH_INFO: `/v3/projects/d355d071519841ab878f73de2527b39d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.022696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d355d071519841ab878f73de2527b39d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.024579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.071778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd355d071519841ab878f73de2527b39d', 'request_id': 'req-aa40a6d5-f96c-4755-a265-85ee6e5d7486'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:23.078057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd355d071519841ab878f73de2527b39d', 'request_id': 'req-aa40a6d5-f96c-4755-a265-85ee6e5d7486'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:23.085528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd355d071519841ab878f73de2527b39d', 'request_id': 'req-aa40a6d5-f96c-4755-a265-85ee6e5d7486'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:23.095706 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] The token cache is being invalidate because project d355d071519841ab878f73de2527b39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:23.095996 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:23.096612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-aa40a6d5-f96c-4755-a265-85ee6e5d7486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:23.098104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1126/2254] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:22 2022] DELETE /identity/v3/projects/d355d071519841ab878f73de2527b39d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:23.103614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.104093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.104186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.124015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:23.125205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:23.183788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1129/2255] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:23.191350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4b451-f903-4545-8335-6799a053d549 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.191627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4b451-f903-4545-8335-6799a053d549 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.191895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4b451-f903-4545-8335-6799a053d549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.212061 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-24a4b451-f903-4545-8335-6799a053d549 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:23.213239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-24a4b451-f903-4545-8335-6799a053d549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:23.220860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1127/2256] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:23.224918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.235472 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cac36-a294-4459-86ff-8f720e18ff70 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.239830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.240414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.240689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.241459 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.242181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:23.242480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.244055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.255670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1130/2257] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:07:23.260059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4b451-f903-4545-8335-6799a053d549 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.269261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4b451-f903-4545-8335-6799a053d549 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.274639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.275246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.275521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.275790 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.276423 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.278334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.310414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1128/2258] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:23.313289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.323486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4605d9c-8ede-4d99-b540-cd250b4b6d2a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.331526 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:23.386814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.387425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.387706 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.388395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.388595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.390587 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.414086 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1131/2259] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:23.417889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.432415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b08c8c-c6c0-4b98-9945-17bad1563afc admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.440190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.440190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.440190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.440190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.440592 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.441628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.455995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1129/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:23.457400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.468378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae3a3-caa1-4470-8b0b-699e7c1dd0e8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.473277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe577d-a43b-4341-a17d-8192861ca83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.473984 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe577d-a43b-4341-a17d-8192861ca83d admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.474349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe577d-a43b-4341-a17d-8192861ca83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.474689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe577d-a43b-4341-a17d-8192861ca83d admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.476009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe577d-a43b-4341-a17d-8192861ca83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.477705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe577d-a43b-4341-a17d-8192861ca83d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.493647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1132/2261] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:23.494474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.504544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8bf38-958b-462c-a1db-74e9e5046d98 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.509711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.510473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.510971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.511261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] PATH_INFO: `/v3/projects/1ded30e6eaf34741826d0068ea748178/users/a110fc87b41b4d03a5c7d5b5ca1817cd/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.526692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ded30e6eaf34741826d0068ea748178, user_id=a110fc87b41b4d03a5c7d5b5ca1817cd, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.529515 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.544234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1130/2262] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:23 2022] PUT /identity/v3/projects/1ded30e6eaf34741826d0068ea748178/users/a110fc87b41b4d03a5c7d5b5ca1817cd/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:23.555652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.555941 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.556216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.583840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] MFA Rules not processed for user `a110fc87b41b4d03a5c7d5b5ca1817cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:23.585678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:23.652281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1133/2263] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:23.656914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.727018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:23.742569 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155b501-22c9-424b-9026-0df6c6e1ddd6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.750298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.751087 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.751369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.751766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.752264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.754284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.788669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1131/2264] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:23.793188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.805933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4bb81-3f47-484a-89f7-ea8044c00d6e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.862929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.863535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.863810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.864079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.864701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.867201 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.888464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1134/2265] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:23 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:23.892444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.902689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930bcfa-4d31-42ea-9ad2-9b7bbf003a39 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.907228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.908006 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.908285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.908560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.909347 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.911049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.922391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1132/2266] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:23.926363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.936874 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0482b0-e7ed-4b3e-82de-8477912a7c4f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:23.941395 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:23.942075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:23.942354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:23.942627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] PATH_INFO: `/v3/projects/f471f020931c4682832e98b68ab70fcf/users/eb3dca7be9d04ac48ef6656a64135f1a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:23.947053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:23.963514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f471f020931c4682832e98b68ab70fcf, user_id=eb3dca7be9d04ac48ef6656a64135f1a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:23.966701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:23.980286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1135/2267] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:23 2022] PUT /identity/v3/projects/f471f020931c4682832e98b68ab70fcf/users/eb3dca7be9d04ac48ef6656a64135f1a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:23.984861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:23.996343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9176a-e0ba-4bd1-b02d-b671525b41f1 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:24.052603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e0b0c-3a57-4a5c-9e33-d7d06b6774e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:24.053257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0b0c-3a57-4a5c-9e33-d7d06b6774e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:24.053516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0b0c-3a57-4a5c-9e33-d7d06b6774e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:24.053822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0b0c-3a57-4a5c-9e33-d7d06b6774e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:24.054461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0b0c-3a57-4a5c-9e33-d7d06b6774e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:24.056082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0b0c-3a57-4a5c-9e33-d7d06b6774e1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:24.065636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1133/2268] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:24.069730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:24.079677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391708e3-5443-4480-9790-dec75efc8ca5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:24.084166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:24.085406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:24.085682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:24.085989 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] PATH_INFO: `/v3/projects/f471f020931c4682832e98b68ab70fcf/users/eb3dca7be9d04ac48ef6656a64135f1a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:24.087898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f471f020931c4682832e98b68ab70fcf, user_id=eb3dca7be9d04ac48ef6656a64135f1a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:24.090555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:24.101088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1136/2269] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:24 2022] PUT /identity/v3/projects/f471f020931c4682832e98b68ab70fcf/users/eb3dca7be9d04ac48ef6656a64135f1a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:24.112372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:24.112662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:24.112935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:24.140366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] MFA Rules not processed for user `eb3dca7be9d04ac48ef6656a64135f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:24.141568 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:24.207012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1134/2270] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:24.219344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:24.221037 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:24.281161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3791-68e2-49c9-8a46-577c3b598377 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:24.284594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:24.285191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:24.285463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:24.285729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:24.295016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:24.296421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:24.305707 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1137/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:24.379969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:24.390226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b410-c780-4e7a-a559-a0ab8ec26732 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:24.393810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39ba4-75d2-4d97-84ca-0104519d9b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:24.394404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39ba4-75d2-4d97-84ca-0104519d9b83 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:24.394678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39ba4-75d2-4d97-84ca-0104519d9b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:24.394947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39ba4-75d2-4d97-84ca-0104519d9b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:24.438139 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:24.451207 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39ba4-75d2-4d97-84ca-0104519d9b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:24.452630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39ba4-75d2-4d97-84ca-0104519d9b83 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:24.461968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1135/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:31.396964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:31.457173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0237-da3a-4cc1-b5af-fe0bc925434c service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:31.461627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:31.462274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:31.462549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:31.462815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] PATH_INFO: `/v3/users/a110fc87b41b4d03a5c7d5b5ca1817cd` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:31.463920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a110fc87b41b4d03a5c7d5b5ca1817cd)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:31.465851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:31.511331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a110fc87b41b4d03a5c7d5b5ca1817cd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:31.511898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a110fc87b41b4d03a5c7d5b5ca1817cd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:31.518730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a110fc87b41b4d03a5c7d5b5ca1817cd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:31.519346 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a110fc87b41b4d03a5c7d5b5ca1817cd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:31.526463 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a110fc87b41b4d03a5c7d5b5ca1817cd'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:31.536599 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:31.545683 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1138/2273] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:31 2022] DELETE /identity/v3/users/a110fc87b41b4d03a5c7d5b5ca1817cd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:31.550162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:31.550649 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:31.550752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:31.570138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:31.571342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:31.627975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1136/2274] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:31.638337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:31.639722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:31.696370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008300-7cab-4c58-ae34-7e31f994c340 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:31.699985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:31.700581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:31.700860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:31.701130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:31.710421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:31.712068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:31.721407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1139/2275] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:32.074771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:32.076208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:32.088887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bd0f-6547-40c9-9e08-ca0ee471bf33 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:32.093492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:32.094157 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.094433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.094703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] PATH_INFO: `/v3/projects/1ded30e6eaf34741826d0068ea748178` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.095822 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ded30e6eaf34741826d0068ea748178)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:32.097727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:32.144449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ded30e6eaf34741826d0068ea748178', 'request_id': 'req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.151292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ded30e6eaf34741826d0068ea748178', 'request_id': 'req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.158693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ded30e6eaf34741826d0068ea748178', 'request_id': 'req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.168908 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] The token cache is being invalidate because project 1ded30e6eaf34741826d0068ea748178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:32.169195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.169854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.171328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1137/2276] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:32 2022] DELETE /identity/v3/projects/1ded30e6eaf34741826d0068ea748178 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:32.175332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:32.185389 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4553-a5c9-4650-8deb-e05a4c1b99da service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:32.240483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:32.241096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.242068 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.242356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] PATH_INFO: `/v3/users/eb3dca7be9d04ac48ef6656a64135f1a` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.243428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3dca7be9d04ac48ef6656a64135f1a)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:32.245329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:32.290158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3dca7be9d04ac48ef6656a64135f1a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.290724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3dca7be9d04ac48ef6656a64135f1a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.297390 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3dca7be9d04ac48ef6656a64135f1a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.298032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3dca7be9d04ac48ef6656a64135f1a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.306268 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-bf6c4018-4445-4663-9b37-2148af941638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3dca7be9d04ac48ef6656a64135f1a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.323098 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1140/2277] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:32 2022] DELETE /identity/v3/users/eb3dca7be9d04ac48ef6656a64135f1a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:32.597432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:32.599225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:32.613146 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab8fe-2b9c-41ed-92cd-1b35ea13dbd3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:32.672132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:32.672750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.673023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.673287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] PATH_INFO: `/v3/projects/f471f020931c4682832e98b68ab70fcf` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.674403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f471f020931c4682832e98b68ab70fcf)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:32.676278 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:32.687828 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:32.731002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f471f020931c4682832e98b68ab70fcf', 'request_id': 'req-18f2fe78-dc92-4141-8900-65846a057ef7'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.737656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f471f020931c4682832e98b68ab70fcf', 'request_id': 'req-18f2fe78-dc92-4141-8900-65846a057ef7'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.746796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f471f020931c4682832e98b68ab70fcf', 'request_id': 'req-18f2fe78-dc92-4141-8900-65846a057ef7'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.758024 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] The token cache is being invalidate because project f471f020931c4682832e98b68ab70fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:32.758315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.758968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-18f2fe78-dc92-4141-8900-65846a057ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:32.760703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1138/2278] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:32 2022] DELETE /identity/v3/projects/f471f020931c4682832e98b68ab70fcf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:32.765812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.766281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.766481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.787853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:32.790442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:32.801418 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:32.857061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1141/2279] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:32.864778 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.865287 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.865560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.886898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:32.888111 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:32.896228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1139/2280] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:32.901658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:32.911230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292fac1-3c8c-4fe3-aa8e-2be18f2ffcb2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:32.915910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:32.916512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.916791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.917063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.917710 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:32.918044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:32.919648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:32.932373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1142/2281] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:07:32.936042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:32.946815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae6c0-7dc2-454f-b55b-fdc0be2edcbe None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:32.951463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:32.952062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:32.952336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:32.952605 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:32.953229 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:32.955155 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:32.989271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1140/2282] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:32 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:32.990488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.000978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4e12-4d28-4647-8341-5ae2dcf6cb47 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.058479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.059011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.059285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.059556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.060188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.062527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.087719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1143/2283] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:32 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:33.091691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.102986 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6425-7316-4b6d-81ef-691d0c442dea admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.107953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.108558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.108836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.109116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.109769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.111376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.124879 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1141/2284] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:33.126110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.138041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8646-b8b0-4cb0-9a49-d44746b11c4d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.149019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70873029-d8b7-4849-aea3-21cd4181dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.149661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70873029-d8b7-4849-aea3-21cd4181dd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.150566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70873029-d8b7-4849-aea3-21cd4181dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.150566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70873029-d8b7-4849-aea3-21cd4181dd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.150931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70873029-d8b7-4849-aea3-21cd4181dd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.152860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70873029-d8b7-4849-aea3-21cd4181dd9f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.168234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1144/2285] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:33.169372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.179999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5322-0db2-4096-bd9b-d3f0831f7889 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.185449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.186305 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.186654 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.187004 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] PATH_INFO: `/v3/projects/94b09732da6c421ea16aedfc4ae25d58/users/0126d219443a49cdbc04cfdea3433a3c/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.204623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b09732da6c421ea16aedfc4ae25d58, user_id=0126d219443a49cdbc04cfdea3433a3c, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.207294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.223631 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1142/2286] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:33 2022] PUT /identity/v3/projects/94b09732da6c421ea16aedfc4ae25d58/users/0126d219443a49cdbc04cfdea3433a3c/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:33.243400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.244042 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.244385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.274689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] MFA Rules not processed for user `0126d219443a49cdbc04cfdea3433a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:33.275914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:33.348006 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1145/2287] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:33.354075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.424648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47bdd-f58f-4940-a54b-b6802566eb2a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.430127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.430771 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.431051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.431325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.431963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.433911 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.462335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1143/2288] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:33 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:33.466381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.477994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aad0d8-4767-478e-9e0a-ef43bd9fd00a None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.486919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:33.544925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.545614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.546029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.546363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.546974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.548903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.573594 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1146/2289] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:33 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:33.577578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.589587 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac200081-6cc0-4093-947b-6812d3ba6ddb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.603571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.604194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.604483 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.604750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.605459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.607355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.629118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1144/2290] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:33.636138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.664963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede194ac-afd4-4295-9401-e6c288dd411b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.670285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.671121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.671568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.671880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] PATH_INFO: `/v3/projects/a70256363b7f4357a4558325878b8c2e/users/6f89cee7e4a346e198c2343bb3087c75/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.696880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70256363b7f4357a4558325878b8c2e, user_id=6f89cee7e4a346e198c2343bb3087c75, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.700731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.724066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1147/2291] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:33 2022] PUT /identity/v3/projects/a70256363b7f4357a4558325878b8c2e/users/6f89cee7e4a346e198c2343bb3087c75/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:33.725066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.739154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd5ce-6485-4ed1-b3be-6855a4607159 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.750877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:33.826719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5581ba4-7722-41ba-983f-a8e19d0d3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.827994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581ba4-7722-41ba-983f-a8e19d0d3cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.828459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581ba4-7722-41ba-983f-a8e19d0d3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.828890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581ba4-7722-41ba-983f-a8e19d0d3cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.829727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5581ba4-7722-41ba-983f-a8e19d0d3cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.831595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5581ba4-7722-41ba-983f-a8e19d0d3cf5 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.845324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1145/2292] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:33.849179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:33.863020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe08c8-3231-41cb-a08e-6b5d0390190c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:33.869420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:33.870575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.871056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.871511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] PATH_INFO: `/v3/projects/a70256363b7f4357a4558325878b8c2e/users/6f89cee7e4a346e198c2343bb3087c75/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.875107 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70256363b7f4357a4558325878b8c2e, user_id=6f89cee7e4a346e198c2343bb3087c75, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:33.877996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:33.897910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1148/2293] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:33 2022] PUT /identity/v3/projects/a70256363b7f4357a4558325878b8c2e/users/6f89cee7e4a346e198c2343bb3087c75/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:33.901275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:33.901564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:33.901875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:33.932059 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] MFA Rules not processed for user `6f89cee7e4a346e198c2343bb3087c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:33.933285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:34.005562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1146/2294] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:34.018854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:34.020559 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:34.081403 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f949ca-41ba-4a48-af8f-eed6b06753a9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:34.085081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:34.085765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:34.086030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:34.086298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:34.095293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:34.096722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:34.106644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1149/2295] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:34.155049 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:34.156575 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:34.169784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7402-4d01-4d28-b4cb-ae50eb7bd382 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:34.173577 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9440b-e82e-46be-bdc1-f10182884657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:34.174217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9440b-e82e-46be-bdc1-f10182884657 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:34.174493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9440b-e82e-46be-bdc1-f10182884657 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:34.174766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9440b-e82e-46be-bdc1-f10182884657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:34.246203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9440b-e82e-46be-bdc1-f10182884657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:34.247735 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9440b-e82e-46be-bdc1-f10182884657 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:34.274402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1147/2296] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:37.679771 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:37.740285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93535-9d60-4bd4-9065-a662c36af638 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:37.744993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:37.745609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:37.745916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:37.746192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] PATH_INFO: `/v3/users/0126d219443a49cdbc04cfdea3433a3c` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:37.747302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0126d219443a49cdbc04cfdea3433a3c)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:37.749215 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:37.755007 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:37.797275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0126d219443a49cdbc04cfdea3433a3c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:37.797991 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0126d219443a49cdbc04cfdea3433a3c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:37.806245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0126d219443a49cdbc04cfdea3433a3c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:37.806875 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0126d219443a49cdbc04cfdea3433a3c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:37.815421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0126d219443a49cdbc04cfdea3433a3c'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:37.833700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1150/2297] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:37 2022] DELETE /identity/v3/users/0126d219443a49cdbc04cfdea3433a3c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:37.839200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:37.839659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:37.839751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:37.859180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:37.860366 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:37.886890 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:37.920683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1148/2298] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:37.930561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:37.931933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:37.990157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390753bf-f6fb-4969-b935-43ac66e4ef91 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:37.994260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:37.994861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:37.995138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:37.995404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:38.004279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:38.005686 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:38.016290 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1151/2299] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:38.281424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:38.283060 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:38.298594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852214b2-41c8-4f37-84ef-331f0c2b26e4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:38.304924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:38.305600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:38.305958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:38.306158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] PATH_INFO: `/v3/projects/94b09732da6c421ea16aedfc4ae25d58` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:38.307323 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b09732da6c421ea16aedfc4ae25d58)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:38.309246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:38.356504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b09732da6c421ea16aedfc4ae25d58', 'request_id': 'req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.362760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b09732da6c421ea16aedfc4ae25d58', 'request_id': 'req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.370850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b09732da6c421ea16aedfc4ae25d58', 'request_id': 'req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.383083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] The token cache is being invalidate because project 94b09732da6c421ea16aedfc4ae25d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:38.383369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.384120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.386289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1149/2300] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:38 2022] DELETE /identity/v3/projects/94b09732da6c421ea16aedfc4ae25d58 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:38.390065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:38.401168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66f65-da8b-4e39-8050-be438501b586 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:38.461480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:38.462203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:38.462564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:38.462895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] PATH_INFO: `/v3/users/6f89cee7e4a346e198c2343bb3087c75` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:38.464075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f89cee7e4a346e198c2343bb3087c75)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:38.466180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:38.500762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:38.516748 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f89cee7e4a346e198c2343bb3087c75'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.517124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f89cee7e4a346e198c2343bb3087c75'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.525318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f89cee7e4a346e198c2343bb3087c75'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.526180 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f89cee7e4a346e198c2343bb3087c75'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.535002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c5dfd96f-68ca-46a2-ae85-acd78d9e617b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f89cee7e4a346e198c2343bb3087c75'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.554414 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1152/2301] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:38 2022] DELETE /identity/v3/users/6f89cee7e4a346e198c2343bb3087c75 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:38.822562 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:38.824080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:38.837993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e01f0-edf0-45f2-a5aa-20a0e70fb97a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:38.895237 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:38.895904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:38.896121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:38.896388 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] PATH_INFO: `/v3/projects/a70256363b7f4357a4558325878b8c2e` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:38.898116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70256363b7f4357a4558325878b8c2e)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:38.900018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:38.946062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70256363b7f4357a4558325878b8c2e', 'request_id': 'req-6a0ba4be-a1b0-4552-bc91-05c5a778944a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.951939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70256363b7f4357a4558325878b8c2e', 'request_id': 'req-6a0ba4be-a1b0-4552-bc91-05c5a778944a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.954775 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:38.959546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70256363b7f4357a4558325878b8c2e', 'request_id': 'req-6a0ba4be-a1b0-4552-bc91-05c5a778944a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.972847 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] The token cache is being invalidate because project a70256363b7f4357a4558325878b8c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:38.973130 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.973807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6a0ba4be-a1b0-4552-bc91-05c5a778944a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:38.975264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1150/2302] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:38 2022] DELETE /identity/v3/projects/a70256363b7f4357a4558325878b8c2e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:38.980884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:38.981360 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:38.981477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.001074 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:39.002277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:39.060405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1153/2303] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:39.068300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.068591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.068871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.088941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:39.090161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:39.097927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1151/2304] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:39.102666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.112133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bd3b1-fbd9-468f-9607-279ff1313255 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.116733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.117311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.117593 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.117909 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.118557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:39.118860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.120451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.132047 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1154/2305] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:07:39.136623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.145593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dda2e-1d64-4f8b-8065-0942319d4e04 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.150767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.151348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.151621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.151887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.152501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.154425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.185788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1152/2306] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:39.187733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.198081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd389e7f-5d4f-4293-a53e-8a2285ec76bf admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.252793 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.253393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.253672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.253974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.254609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.256585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.281443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1155/2307] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:39.285570 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.296947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46713-392f-4257-83ef-c32db68eed1e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.301543 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.302169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.302448 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.302720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.303548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.305476 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.320407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1153/2308] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:39.324412 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.334377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636deba0-02fc-4e69-8b27-bff4cba60cc0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.339596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78dae0-84c2-4318-95b2-283f33e1dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.340189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78dae0-84c2-4318-95b2-283f33e1dafb admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.340468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78dae0-84c2-4318-95b2-283f33e1dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.340744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78dae0-84c2-4318-95b2-283f33e1dafb admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.341382 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78dae0-84c2-4318-95b2-283f33e1dafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.343021 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78dae0-84c2-4318-95b2-283f33e1dafb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.353713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1156/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:39.357705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.367882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd68ef-722a-4833-b958-c5f38948d47d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.372774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.373419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.373692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.373989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] PATH_INFO: `/v3/projects/7fbc473341424e17a99fc4bec997b619/users/0aea479517894cd98303d7602349c0ac/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.389007 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbc473341424e17a99fc4bec997b619, user_id=0aea479517894cd98303d7602349c0ac, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.391646 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.404625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1154/2310] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:39 2022] PUT /identity/v3/projects/7fbc473341424e17a99fc4bec997b619/users/0aea479517894cd98303d7602349c0ac/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:39.415831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.416123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.416400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.440960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:39.444995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] MFA Rules not processed for user `0aea479517894cd98303d7602349c0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:39.447144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:39.511063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1157/2311] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:39.515415 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.578120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54168729-21c2-4622-95d8-7b15d48c5c0c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.583280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.583916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.584194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.584466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.586360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.588622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.617886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1155/2312] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:39.619843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.630502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539c52-40e8-480e-87b1-49eb6ae7403e None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.663731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.665489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:39.699561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.700177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.700462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.700739 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.701373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.703506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.728478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1158/2313] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:39.728702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f827-5a1f-4976-a574-c5d18c4a0ba2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.729596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.732209 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.732821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.733100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.733375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.735144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:39.739244 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f8bda-0ad3-457d-9b1f-441ee4a15004 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.745040 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.745633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.745986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.746200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.746836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.747811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.748441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.749235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.759730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1159/2314] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:39.760492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1156/2315] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:07:39.763645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.773104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e3bb-f0f0-4766-8bb8-8d125f34d72c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.777671 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.778351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.778640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.778918 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] PATH_INFO: `/v3/projects/6f6d1ec9fbaf467a9891a7f4b564ed98/users/0c08f1d1b1af49e8a7044525151131e8/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.794738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6d1ec9fbaf467a9891a7f4b564ed98, user_id=0c08f1d1b1af49e8a7044525151131e8, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.798022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.813925 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1160/2316] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:39 2022] PUT /identity/v3/projects/6f6d1ec9fbaf467a9891a7f4b564ed98/users/0c08f1d1b1af49e8a7044525151131e8/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:39.819962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.829566 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511b037-b931-4201-ab73-998d28e2bcaf service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.834267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:39.889896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2270a9d-4ca5-429d-ab82-0a0282e23c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.890505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270a9d-4ca5-429d-ab82-0a0282e23c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.890777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270a9d-4ca5-429d-ab82-0a0282e23c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.891042 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270a9d-4ca5-429d-ab82-0a0282e23c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.891675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2270a9d-4ca5-429d-ab82-0a0282e23c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.893251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2270a9d-4ca5-429d-ab82-0a0282e23c59 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.904246 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1157/2317] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:39.908614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:39.919578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9239fb-ab22-4f69-b209-44ef713ca9a1 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:39.924427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:39.925085 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.925363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.925638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] PATH_INFO: `/v3/projects/6f6d1ec9fbaf467a9891a7f4b564ed98/users/0c08f1d1b1af49e8a7044525151131e8/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.927612 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6d1ec9fbaf467a9891a7f4b564ed98, user_id=0c08f1d1b1af49e8a7044525151131e8, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:39.930818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:39.942126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1161/2318] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:39 2022] PUT /identity/v3/projects/6f6d1ec9fbaf467a9891a7f4b564ed98/users/0c08f1d1b1af49e8a7044525151131e8/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:39.953723 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:39.954055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:39.954333 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:39.988331 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] MFA Rules not processed for user `0c08f1d1b1af49e8a7044525151131e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:39.989525 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:40.058591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1158/2319] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:40.069561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:40.071537 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:40.121359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:40.133321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5fe0-e90e-4662-bc11-35a8c90c6500 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:40.137305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:40.137950 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:40.138229 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:40.138497 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:40.148072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:40.149498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:40.159240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1162/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:40.206228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:40.207888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:40.220164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0209-4f3b-4917-8d8b-e8e1bd1574fe None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:40.223878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:40.224547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:40.224889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:40.225760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:40.284282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:40.285767 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:40.295289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1159/2321] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:43.030589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.032075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.104416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5a639-76bb-4f14-b93a-2a0d4917aa3b service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.105629 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.107907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.109387 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.110029 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.110316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.110572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.112285 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.125353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.126971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.138158 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1163/2322] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:43.146062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:43.184412 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6adcb-3a8e-4673-bb45-b20c35b989cf service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.189235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.189899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.190180 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.190453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] PATH_INFO: `/v3/users/ed2a06712005416ba12560278b0adc5b` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.191585 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2a06712005416ba12560278b0adc5b)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.193560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.239574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2a06712005416ba12560278b0adc5b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.246434 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2a06712005416ba12560278b0adc5b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.247102 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2a06712005416ba12560278b0adc5b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.254409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2a06712005416ba12560278b0adc5b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.255182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-d721f817-bdb1-4d8b-a356-9fca68034f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2a06712005416ba12560278b0adc5b'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.274659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1160/2323] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:43 2022] DELETE /identity/v3/users/ed2a06712005416ba12560278b0adc5b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:43.461619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.472137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c845b-e941-4591-8e0a-616066116b41 service placement] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.537401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.539174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.539522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.539855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] PATH_INFO: `/v3/projects/7f0c4174700f433fbe8e3d59e766cbef` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.541039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0c4174700f433fbe8e3d59e766cbef)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.543536 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.592117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0c4174700f433fbe8e3d59e766cbef', 'request_id': 'req-8f251143-000c-433d-a965-4b4aba5149d0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.598351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0c4174700f433fbe8e3d59e766cbef', 'request_id': 'req-8f251143-000c-433d-a965-4b4aba5149d0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.606377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0c4174700f433fbe8e3d59e766cbef', 'request_id': 'req-8f251143-000c-433d-a965-4b4aba5149d0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.618650 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] The token cache is being invalidate because project 7f0c4174700f433fbe8e3d59e766cbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:43.618867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.619520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.621097 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1164/2324] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:43 2022] DELETE /identity/v3/projects/7f0c4174700f433fbe8e3d59e766cbef => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:43.626297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc2e19-281f-42bb-b76b-4acefbdf0fa8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.626865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc2e19-281f-42bb-b76b-4acefbdf0fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.627208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc2e19-281f-42bb-b76b-4acefbdf0fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.648688 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-44fc2e19-281f-42bb-b76b-4acefbdf0fa8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:43.650075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-44fc2e19-281f-42bb-b76b-4acefbdf0fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.698762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.700381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.709297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:43.713329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1161/2325] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:43.722316 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.722602 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.722883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.743204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:43.744407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.752243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1162/2326] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:43.756429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.766327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cd3a1-21d3-4604-b797-621d7e4b83f3 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.769381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f251143-000c-433d-a965-4b4aba5149d0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.770917 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.771500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.771886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.772300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.772952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:43.773251 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.774305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.774897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.775012 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.775217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.775487 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] PATH_INFO: `/v3/users/0aea479517894cd98303d7602349c0ac` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.776607 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aea479517894cd98303d7602349c0ac)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.778604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.786439 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1163/2327] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:07:43.790655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.800750 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219983f2-3656-41e4-a665-04b28ad9d250 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.806600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.807188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.807462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.807814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.808355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.811295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.827833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aea479517894cd98303d7602349c0ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.828557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aea479517894cd98303d7602349c0ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.836499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aea479517894cd98303d7602349c0ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.837154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aea479517894cd98303d7602349c0ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.840188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1164/2328] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:43 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:43.844189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.845979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.846871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d4064d88-2889-4560-971b-4ebae2f60f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aea479517894cd98303d7602349c0ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:43.856283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:43.867737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1165/2329] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:43 2022] DELETE /identity/v3/users/0aea479517894cd98303d7602349c0ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:43.872906 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.873122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.873391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.892944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:43.894350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.914717 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66560d65-4c63-472d-9810-71d4e5a2bee3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:43.952269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1166/2330] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:43.963311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:43.964661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:43.973868 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:43.974477 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:43.974753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:43.975021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:43.976161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:43.978094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:43.996870 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:44.005068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1165/2331] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:43 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:44.006818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.017551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa6cf-2d82-4459-9bb4-28f6486e23da admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.023337 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.023941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.024220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.024494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.025136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.026759 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.030436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d893e-0c81-4dea-ac8c-8822789ea200 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.034115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.034717 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.034986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.035259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.036834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1166/2332] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:44.041426 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.045241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.046737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.050947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1afc-2c67-49b9-8c12-f29821f3b21d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.056192 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1167/2333] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:07:44.056497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54e3c8-fbb9-4151-912b-dbb7faa3923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.057079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e3c8-fbb9-4151-912b-dbb7faa3923e admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.057374 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e3c8-fbb9-4151-912b-dbb7faa3923e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.057630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e3c8-fbb9-4151-912b-dbb7faa3923e admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.058295 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54e3c8-fbb9-4151-912b-dbb7faa3923e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.059867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54e3c8-fbb9-4151-912b-dbb7faa3923e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.072092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1167/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:44.076339 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.086550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76fe9-f6ac-4bf4-9ae4-1aaebe52306a service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.091324 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.092096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.092373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.092640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] PATH_INFO: `/v3/projects/a99436a71dc5465190cc0d092a500974/users/462021911ee64cbc9a62ee9865532866/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.108519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99436a71dc5465190cc0d092a500974, user_id=462021911ee64cbc9a62ee9865532866, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.111504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.126516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1168/2335] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:44 2022] PUT /identity/v3/projects/a99436a71dc5465190cc0d092a500974/users/462021911ee64cbc9a62ee9865532866/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:44.139304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.139821 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.139984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.169466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] MFA Rules not processed for user `462021911ee64cbc9a62ee9865532866`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:44.170866 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.237622 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1168/2336] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:44.242353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.307841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d1a4-fe5b-4f25-89f5-f1c20fe58445 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.312695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.313298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.313600 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.313883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.314521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.316428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.337965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.339984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.354275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab508-0fcb-4afd-962e-31aac0fd675b None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.356315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1169/2337] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:44 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:44.357189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.364274 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:44.420239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.420782 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.421055 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.421322 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] PATH_INFO: `/v3/projects/7fbc473341424e17a99fc4bec997b619` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.422458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbc473341424e17a99fc4bec997b619)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.422955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2b2eb-3976-4055-b549-b8abc18e8bfe admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.424404 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.427523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.428640 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.428949 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.429330 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.429981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.431871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.456755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1170/2338] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:44 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:44.458050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.468440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c668eef-af96-4ed8-bd3f-66d87d321105 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.472432 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbc473341424e17a99fc4bec997b619', 'request_id': 'req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.479523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbc473341424e17a99fc4bec997b619', 'request_id': 'req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.487998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:44.490131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbc473341424e17a99fc4bec997b619', 'request_id': 'req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.501952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] The token cache is being invalidate because project 7fbc473341424e17a99fc4bec997b619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:44.502234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.502883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.504373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1169/2339] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:44 2022] DELETE /identity/v3/projects/7fbc473341424e17a99fc4bec997b619 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:44.508317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.509927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.529971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.530579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.530854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.531126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.532046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.533627 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.543767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1171/2340] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:44.547833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.549529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.562518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a03a9-2091-4695-a23b-37963a604609 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.567625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.568260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.568534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.568915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] PATH_INFO: `/v3/projects/1a16ccdbe1f947feaf5a0e19c5fd6102/users/bb23603a58c8429fb1a79badd94c9ca2/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.577252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018b6a2-4ba5-4d39-90dc-e11a773c88a6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.581980 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.582648 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.582886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.583161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] PATH_INFO: `/v3/users/0c08f1d1b1af49e8a7044525151131e8` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.583362 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a16ccdbe1f947feaf5a0e19c5fd6102, user_id=bb23603a58c8429fb1a79badd94c9ca2, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.584302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c08f1d1b1af49e8a7044525151131e8)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.586109 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.586480 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.600652 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1172/2341] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:44 2022] PUT /identity/v3/projects/1a16ccdbe1f947feaf5a0e19c5fd6102/users/bb23603a58c8429fb1a79badd94c9ca2/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:44.605017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.638812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:44.641101 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c08f1d1b1af49e8a7044525151131e8'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.648678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c08f1d1b1af49e8a7044525151131e8'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.649901 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c08f1d1b1af49e8a7044525151131e8'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.657937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c08f1d1b1af49e8a7044525151131e8'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.658588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c08f1d1b1af49e8a7044525151131e8'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:44.669952 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1211-2128-4f81-89e1-e96976d97384 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.674676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49555f-7901-461a-81c0-9bcdb46422c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.675211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49555f-7901-461a-81c0-9bcdb46422c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.675492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49555f-7901-461a-81c0-9bcdb46422c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.675757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49555f-7901-461a-81c0-9bcdb46422c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.676393 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49555f-7901-461a-81c0-9bcdb46422c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.676862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1170/2342] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:44 2022] DELETE /identity/v3/users/0c08f1d1b1af49e8a7044525151131e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:44.678188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49555f-7901-461a-81c0-9bcdb46422c9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.691636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1173/2343] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:44.692823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.694290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.763880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1e2db-4822-4549-80a3-33b9d2318eaa admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:44.768653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:44.769382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.769729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.770091 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] PATH_INFO: `/v3/projects/1a16ccdbe1f947feaf5a0e19c5fd6102/users/bb23603a58c8429fb1a79badd94c9ca2/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.772661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a16ccdbe1f947feaf5a0e19c5fd6102, user_id=bb23603a58c8429fb1a79badd94c9ca2, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:44.775427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:44.786332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1171/2344] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:44 2022] PUT /identity/v3/projects/1a16ccdbe1f947feaf5a0e19c5fd6102/users/bb23603a58c8429fb1a79badd94c9ca2/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:44.798436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:44.798737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:44.799105 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:44.830935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] MFA Rules not processed for user `bb23603a58c8429fb1a79badd94c9ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:44.832255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.906016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1174/2345] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:44.917593 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.919317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.963860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:44.965538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:44.986674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:45.002117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41335b5-db77-4ae7-904d-29154ec661e7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.005875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee299be-566e-4959-a16d-683fb23b3df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.006679 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee299be-566e-4959-a16d-683fb23b3df2 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.006965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee299be-566e-4959-a16d-683fb23b3df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.007240 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee299be-566e-4959-a16d-683fb23b3df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.017029 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee299be-566e-4959-a16d-683fb23b3df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.018491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee299be-566e-4959-a16d-683fb23b3df2 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.028653 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1172/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:45.038915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4d158-cd81-483d-b6fd-1541704ac557 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.043631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.044257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.044529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.044796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] PATH_INFO: `/v3/projects/6f6d1ec9fbaf467a9891a7f4b564ed98` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.046055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6d1ec9fbaf467a9891a7f4b564ed98)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.047987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.101938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6d1ec9fbaf467a9891a7f4b564ed98', 'request_id': 'req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.108129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6d1ec9fbaf467a9891a7f4b564ed98', 'request_id': 'req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.116273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6d1ec9fbaf467a9891a7f4b564ed98', 'request_id': 'req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.127898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] The token cache is being invalidate because project 6f6d1ec9fbaf467a9891a7f4b564ed98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:45.128240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.129439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.131664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1175/2347] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:44 2022] DELETE /identity/v3/projects/6f6d1ec9fbaf467a9891a7f4b564ed98 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:45.137293 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933acd6-36d6-49e9-ad85-5cea1d487a20 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.137581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933acd6-36d6-49e9-ad85-5cea1d487a20 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.138212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933acd6-36d6-49e9-ad85-5cea1d487a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.157891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-0933acd6-36d6-49e9-ad85-5cea1d487a20 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:45.159092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0933acd6-36d6-49e9-ad85-5cea1d487a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.177988 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.179664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.214538 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:45.226315 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1173/2348] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:45.233683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.234001 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.234280 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.251010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7f13-bf9d-421a-92fc-dcd8c05a5ec6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.253719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:45.254945 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.255616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.256306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.256579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.256986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] PATH_INFO: `/v3/users/462021911ee64cbc9a62ee9865532866` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.258137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462021911ee64cbc9a62ee9865532866)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.260340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.263354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1174/2349] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:45.267478 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.277459 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835df3c2-3470-49ad-9b93-f792cd643562 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.281943 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.282537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.282815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.283084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.283719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:45.284016 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.285720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.299413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1175/2350] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:07:45.303976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.307596 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:45.309465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462021911ee64cbc9a62ee9865532866'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.310473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462021911ee64cbc9a62ee9865532866'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.314666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178ce73-02b2-4403-813e-1b4eecec86ba admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.320152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.320298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462021911ee64cbc9a62ee9865532866'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.320734 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.320906 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462021911ee64cbc9a62ee9865532866'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.321014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.321401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.322062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.323944 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.328464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-3d2ee507-0b93-448c-ac9a-936499b694b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462021911ee64cbc9a62ee9865532866'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.347872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1176/2351] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:45 2022] DELETE /identity/v3/users/462021911ee64cbc9a62ee9865532866 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:45.352281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.352566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.352892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.354977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1176/2352] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:45 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:45.358971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.362589 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.373193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:45.374411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.428314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6a139-0897-4593-87ab-529eebcb5fa4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.431695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1177/2353] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:45.432993 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.433599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.433912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.434186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.434912 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.436832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.441564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.442910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.459088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1177/2354] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:45 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:45.463152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.473083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83749-08c9-4c2e-bfa5-72e8deb2440f admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.478387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.478981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.479264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.479563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.480199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.481826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.495521 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1178/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:45.496555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.501654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84a8b7-d948-4b13-9fc7-e18085f4788f None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.505546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970219af-cb70-442e-998e-ca2f5d07ff7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.506069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaef19-e2fa-4b9c-a4ec-090733eaad09 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.506209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970219af-cb70-442e-998e-ca2f5d07ff7a service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.506561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970219af-cb70-442e-998e-ca2f5d07ff7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.506827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970219af-cb70-442e-998e-ca2f5d07ff7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.511348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.511935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.512218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.512497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.513127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.514761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.516490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970219af-cb70-442e-998e-ca2f5d07ff7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.518284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970219af-cb70-442e-998e-ca2f5d07ff7a service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.525493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1179/2356] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:45.528814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1178/2357] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:07:45.529709 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.539981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e2e4-260f-43ed-a41d-2f1d6dc24b75 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.544743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.545461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.545769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.546047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] PATH_INFO: `/v3/projects/510a823cbc06400eab405094ad1f2eaf/users/144d734dada64e379d8f105662ce59e2/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.561675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=510a823cbc06400eab405094ad1f2eaf, user_id=144d734dada64e379d8f105662ce59e2, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.564344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.578429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1180/2358] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:45 2022] PUT /identity/v3/projects/510a823cbc06400eab405094ad1f2eaf/users/144d734dada64e379d8f105662ce59e2/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:45.590687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.591009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.591427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.622632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] MFA Rules not processed for user `144d734dada64e379d8f105662ce59e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:45.623914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.684152 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:45.699725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1179/2359] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:45.707191 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.708931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.770519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb969d-c3d9-4449-bb1a-a4bf2db8a82e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.774548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.775582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.775582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.775792 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.784414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.785873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.795446 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1181/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:45.808661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.810155 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.820332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.824486 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:45.891696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde9f2-a50d-4577-b3ef-677f1767fb96 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.896245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee81b-f286-4d47-a6b7-4e1fc0a6d852 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:45.896673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.897845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.898166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.898433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] PATH_INFO: `/v3/users/144d734dada64e379d8f105662ce59e2` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.899571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144d734dada64e379d8f105662ce59e2)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.901464 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:45.901579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.902126 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:45.902407 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:45.902684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] PATH_INFO: `/v3/projects/a99436a71dc5465190cc0d092a500974` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:45.903842 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99436a71dc5465190cc0d092a500974)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:45.905757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:45.951145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144d734dada64e379d8f105662ce59e2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.954543 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99436a71dc5465190cc0d092a500974', 'request_id': 'req-a817cff2-485c-42f4-95c4-ad42688dd9b9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.960181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144d734dada64e379d8f105662ce59e2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.961435 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99436a71dc5465190cc0d092a500974', 'request_id': 'req-a817cff2-485c-42f4-95c4-ad42688dd9b9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.962152 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144d734dada64e379d8f105662ce59e2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.970417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99436a71dc5465190cc0d092a500974', 'request_id': 'req-a817cff2-485c-42f4-95c4-ad42688dd9b9'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.972581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144d734dada64e379d8f105662ce59e2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.973349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-10ede85a-2411-48d0-aea8-60308d1d9657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144d734dada64e379d8f105662ce59e2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.981839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] The token cache is being invalidate because project a99436a71dc5465190cc0d092a500974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:45.982063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.982705 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:45.984354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1180/2361] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:45 2022] DELETE /identity/v3/projects/a99436a71dc5465190cc0d092a500974 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:45.987965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:45.989297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:45.998513 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1182/2362] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:45 2022] DELETE /identity/v3/users/144d734dada64e379d8f105662ce59e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:46.002706 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.002994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.003319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.022753 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:46.023970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.055830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817cff2-485c-42f4-95c4-ad42688dd9b9 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.085133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1183/2363] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:46.085343 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:46.095128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.096793 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.116174 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.117177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.117461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.117728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] PATH_INFO: `/v3/users/bb23603a58c8429fb1a79badd94c9ca2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.118944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb23603a58c8429fb1a79badd94c9ca2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.120849 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.124400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:46.160353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97b512-0079-4b34-804d-29de1f2d73f8 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.164660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.165325 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.165591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.165938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.171903 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb23603a58c8429fb1a79badd94c9ca2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.172562 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb23603a58c8429fb1a79badd94c9ca2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.175291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.177038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.179584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb23603a58c8429fb1a79badd94c9ca2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.180252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb23603a58c8429fb1a79badd94c9ca2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.187419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1184/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:07:46.189443 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb23603a58c8429fb1a79badd94c9ca2'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.207871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1181/2365] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:45 2022] DELETE /identity/v3/users/bb23603a58c8429fb1a79badd94c9ca2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:46.485971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.487854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.510965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3c47-b639-48c6-a779-4ed5b9f89310 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.515664 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.517447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.584118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.585639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.586014 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.586375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] PATH_INFO: `/v3/projects/510a823cbc06400eab405094ad1f2eaf` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.587836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510a823cbc06400eab405094ad1f2eaf)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.590643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.603471 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b6f0f-53fb-4497-bd86-ec5ef343c2c7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.608088 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.608730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.609015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.609311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] PATH_INFO: `/v3/projects/1a16ccdbe1f947feaf5a0e19c5fd6102` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.610453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a16ccdbe1f947feaf5a0e19c5fd6102)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.612436 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.639805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510a823cbc06400eab405094ad1f2eaf', 'request_id': 'req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.646511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510a823cbc06400eab405094ad1f2eaf', 'request_id': 'req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.653841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510a823cbc06400eab405094ad1f2eaf', 'request_id': 'req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.662662 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a16ccdbe1f947feaf5a0e19c5fd6102', 'request_id': 'req-a5b26090-26c7-41b7-af5f-11e371d2e99f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.664718 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] The token cache is being invalidate because project 510a823cbc06400eab405094ad1f2eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:46.665008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.665850 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-67e4ba0e-8234-4f4d-8940-b04f708e8fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.667409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1185/2366] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:46 2022] DELETE /identity/v3/projects/510a823cbc06400eab405094ad1f2eaf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:46.671446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a16ccdbe1f947feaf5a0e19c5fd6102', 'request_id': 'req-a5b26090-26c7-41b7-af5f-11e371d2e99f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.672238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5345e-8a66-420e-8300-b63908741622 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.672576 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5345e-8a66-420e-8300-b63908741622 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.672838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5345e-8a66-420e-8300-b63908741622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.673127 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:46.681859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a16ccdbe1f947feaf5a0e19c5fd6102', 'request_id': 'req-a5b26090-26c7-41b7-af5f-11e371d2e99f'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.694437 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] The token cache is being invalidate because project 1a16ccdbe1f947feaf5a0e19c5fd6102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:46.694747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.695233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-58c5345e-8a66-420e-8300-b63908741622 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:46.695363 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-a5b26090-26c7-41b7-af5f-11e371d2e99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:46.696425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-58c5345e-8a66-420e-8300-b63908741622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.696840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1182/2367] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:46 2022] DELETE /identity/v3/projects/1a16ccdbe1f947feaf5a0e19c5fd6102 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:46.701618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b035e6f-db7b-4d85-91cc-95e8d0d41649 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.701935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b035e6f-db7b-4d85-91cc-95e8d0d41649 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.702220 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b035e6f-db7b-4d85-91cc-95e8d0d41649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.722087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4b035e6f-db7b-4d85-91cc-95e8d0d41649 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:46.723563 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4b035e6f-db7b-4d85-91cc-95e8d0d41649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.750731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:46.766835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1186/2368] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:46.774328 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.774663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.774947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.796232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:46.797604 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.806693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1183/2369] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:46.808181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.808449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.808721 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.811913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1187/2370] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:46.816081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.827304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba0b0c-c692-4ee3-a42c-f1348e1b6cc5 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.832057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.832234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:46.832810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.832924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.833183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.833679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:46.833840 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:46.836153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.836153 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.842298 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1184/2371] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:07:46.846583 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.848740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1188/2372] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:07:46.853598 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.858916 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2516fcf-edf9-4516-905b-ab124962aaf2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.864182 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef382862-4cfa-4d5b-b127-be3197202f12 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.867809 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.868637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.868919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.869026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.869195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.869596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.869920 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.870045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:46.870206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.870378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.870882 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.872061 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.872777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.885225 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1185/2373] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:07:46.889856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.903406 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1189/2374] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:46.903700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e4d5-145f-4ccf-82a9-5f781a411d2b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.907056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:46.974791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.976002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.976440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.976770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.977169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.982284 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:46.982450 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398cca-9b41-4631-9378-afb2d6543fac admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:46.986578 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:46.987275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:46.987621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:46.987968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:46.988712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:46.990836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.012924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1186/2375] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:47.019669 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.019818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1190/2376] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:46 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:47.020946 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.033342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa47b-4199-4509-afb3-9276c6ab150b admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.078166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:47.094944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2c71-b060-4881-b638-1e352b5016b5 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.101944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.102555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.102826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.103093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.103719 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.105248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.105663 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.106039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.106317 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.106591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.107285 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.108941 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.120919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1191/2377] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:47.125430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.133801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1187/2378] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:47 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:47.136420 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105585db-d240-4a73-aef2-6d85e0a8e5be admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.136968 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.141217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.141875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.142142 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.142418 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.143053 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.144637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.148724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fd7d5-d948-49fa-b1e5-39a46ef1de28 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.153904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.154980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.154980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.155171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.155765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.157489 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1192/2379] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:47.158281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.161011 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.170679 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1188/2380] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:47.172267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e2649-e308-4508-a4fc-4d50a00e4fa9 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.174455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.178273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df5c8-0466-4505-9185-1ba180a60352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.179085 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df5c8-0466-4505-9185-1ba180a60352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.179539 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df5c8-0466-4505-9185-1ba180a60352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.179916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df5c8-0466-4505-9185-1ba180a60352 admin admin] PATH_INFO: `/v3/projects/2fd7688656824d5db380ef46cfe62cc6/users/8651d6c539264bd3840cb492bfc5aef0/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.187153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2c686-579d-4d4d-b082-1cc9d6320be6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.193263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.193965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.194392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.194675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.195323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.196945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.199599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df5c8-0466-4505-9185-1ba180a60352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd7688656824d5db380ef46cfe62cc6, user_id=8651d6c539264bd3840cb492bfc5aef0, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.203204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df5c8-0466-4505-9185-1ba180a60352 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.208179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1189/2381] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:47.213490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.225899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1193/2382] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:47 2022] PUT /identity/v3/projects/2fd7688656824d5db380ef46cfe62cc6/users/8651d6c539264bd3840cb492bfc5aef0/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:47.226143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94a481-2900-4831-ba20-b31a9e91d06c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.230968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76a81b-4fb2-4fa3-a9a5-47443d4ddb1e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.231256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76a81b-4fb2-4fa3-a9a5-47443d4ddb1e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.231533 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76a81b-4fb2-4fa3-a9a5-47443d4ddb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.241419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:47.272967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-cd76a81b-4fb2-4fa3-a9a5-47443d4ddb1e None None] MFA Rules not processed for user `8651d6c539264bd3840cb492bfc5aef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:47.274549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-cd76a81b-4fb2-4fa3-a9a5-47443d4ddb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.312969 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.314498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.315003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.315715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] PATH_INFO: `/v3/projects/8de69158a756484697838c4bd00f7c6d/users/aa4e0ecdf8914567a334098938de07a8/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.339402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de69158a756484697838c4bd00f7c6d, user_id=aa4e0ecdf8914567a334098938de07a8, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.342039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.365221 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1190/2383] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:47 2022] PUT /identity/v3/projects/8de69158a756484697838c4bd00f7c6d/users/aa4e0ecdf8914567a334098938de07a8/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:47.366682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.373869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1194/2384] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:47.376975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.380630 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.381668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.383485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.420736 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] MFA Rules not processed for user `aa4e0ecdf8914567a334098938de07a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:47.422019 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.516735 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57982-406b-44b3-a95e-6f3af0fb4d44 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.524733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.524967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1195/2385] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:47.525353 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.525629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.525928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.526291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.528792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.528929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.546529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.548728 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.578356 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1191/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:47.580051 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.640417 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:47.647517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d532dc-0d18-413b-8441-99560769b944 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.652309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.654219 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.654596 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.654966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.685694 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c015e4-9559-4bf3-8aaf-0ec06e977fb0 service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.691430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.692500 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.692873 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.693240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.694868 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.696879 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.704950 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:47.733095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.733304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1192/2387] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:47 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:47.733304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.733468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.735096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.741797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1196/2388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:47.742931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.755923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94994ea5-2720-40a2-b2c1-0757dcdfd6a6 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.808199 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88604381-d7b8-4585-9133-4aaaaf5ed37d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.813250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.814335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.814625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.814905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.818325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:47.833397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.837252 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.847368 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1193/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:47.854532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.855371 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.856018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.856444 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.857254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.859188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.886988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1197/2390] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:47 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:47.890919 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.902681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43fcfe-ebef-4c75-ace0-fc86db32145a service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.908257 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.908944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.909223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.909582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.910340 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.912009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.923352 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1194/2391] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:47.929158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:47.942913 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71900b-413c-4eb3-942b-a59a7ca9a5f0 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:47.951276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:47.952081 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:47.952492 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:47.952876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] PATH_INFO: `/v3/projects/77a5c871a099406b8499de8918bc505d/users/e7c6f43429934592ae0d6613dd400065/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:47.974201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a5c871a099406b8499de8918bc505d, user_id=e7c6f43429934592ae0d6613dd400065, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:47.981770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:47.995398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1198/2392] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:47 2022] PUT /identity/v3/projects/77a5c871a099406b8499de8918bc505d/users/e7c6f43429934592ae0d6613dd400065/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:47.999245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:48.010355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d290-4c07-4641-9aee-032b5aa1ae31 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:48.083457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f1d56-4b14-4399-b791-b26cbe253257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:48.084812 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f1d56-4b14-4399-b791-b26cbe253257 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:48.085273 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f1d56-4b14-4399-b791-b26cbe253257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:48.085670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f1d56-4b14-4399-b791-b26cbe253257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:48.086531 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f1d56-4b14-4399-b791-b26cbe253257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:48.088263 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f1d56-4b14-4399-b791-b26cbe253257 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:48.100478 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1195/2393] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:48.104676 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:48.118696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93460b60-94e2-44ae-bdd7-c328188985e2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:48.124743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:48.125534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:48.125992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:48.126334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] PATH_INFO: `/v3/projects/77a5c871a099406b8499de8918bc505d/users/e7c6f43429934592ae0d6613dd400065/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:48.137900 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a5c871a099406b8499de8918bc505d, user_id=e7c6f43429934592ae0d6613dd400065, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:48.141124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:48.159276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1199/2394] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:48 2022] PUT /identity/v3/projects/77a5c871a099406b8499de8918bc505d/users/e7c6f43429934592ae0d6613dd400065/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:48.170428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:48.170428 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:48.170896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:48.205838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] MFA Rules not processed for user `e7c6f43429934592ae0d6613dd400065`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:48.206738 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:48.239388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:48.293301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1196/2395] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:48.306712 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:48.308818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:48.370039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a6165-fa2d-44bc-9e5a-d6648b3ba4f4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:48.373553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a27ea5-58c5-4808-9665-baf41d1ff861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:48.374187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27ea5-58c5-4808-9665-baf41d1ff861 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:48.374479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27ea5-58c5-4808-9665-baf41d1ff861 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:48.374739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27ea5-58c5-4808-9665-baf41d1ff861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:48.385117 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a27ea5-58c5-4808-9665-baf41d1ff861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:48.387026 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a27ea5-58c5-4808-9665-baf41d1ff861 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:48.396697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1200/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:48.832756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:48.900860 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f0de1-6f6f-4892-b197-c42f7812353a None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:48.905421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:48.906093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:48.906386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:48.906672 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] PATH_INFO: `/v3/users/aa4e0ecdf8914567a334098938de07a8` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:48.907851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4e0ecdf8914567a334098938de07a8)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:48.909880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:48.958781 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4e0ecdf8914567a334098938de07a8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:48.959535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4e0ecdf8914567a334098938de07a8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:48.972104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4e0ecdf8914567a334098938de07a8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:48.972956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4e0ecdf8914567a334098938de07a8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:48.982856 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4e0ecdf8914567a334098938de07a8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.005147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1197/2397] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:48 2022] DELETE /identity/v3/users/aa4e0ecdf8914567a334098938de07a8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:49.009936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:49.010372 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:49.010862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:49.031553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:49.033022 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:49.062103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:49.099131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1201/2398] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:49.121400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:49.123519 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:49.180147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:49.203485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9b5f-ab91-4b61-96de-5983a4cb1496 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:49.211125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:49.212091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:49.212585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:49.212924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:49.224383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:49.226254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:49.246929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1198/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:07:49.640594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:49.641065 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:49.673214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede6a2-3149-45db-9cec-fc633f96d18c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:49.684761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:49.685715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:49.686273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:49.686795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] PATH_INFO: `/v3/projects/8de69158a756484697838c4bd00f7c6d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:49.688411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de69158a756484697838c4bd00f7c6d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:49.690633 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:49.794567 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de69158a756484697838c4bd00f7c6d', 'request_id': 'req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.804861 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de69158a756484697838c4bd00f7c6d', 'request_id': 'req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.816748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de69158a756484697838c4bd00f7c6d', 'request_id': 'req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.830516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] The token cache is being invalidate because project 8de69158a756484697838c4bd00f7c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:49.831144 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.831818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.833427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1202/2400] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:49 2022] DELETE /identity/v3/projects/8de69158a756484697838c4bd00f7c6d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:49.837929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:49.847703 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac241dc-9f62-48cc-af40-e9b28db0ddab service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:49.918032 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:49.918687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:49.919453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:49.919730 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] PATH_INFO: `/v3/users/e7c6f43429934592ae0d6613dd400065` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:49.921000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c6f43429934592ae0d6613dd400065)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:49.923580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:49.991675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c6f43429934592ae0d6613dd400065'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:49.994175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c6f43429934592ae0d6613dd400065'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.012217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c6f43429934592ae0d6613dd400065'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.012959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c6f43429934592ae0d6613dd400065'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.023814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e0325ea7-d7b6-4c1f-a0b0-0147dbd0f2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c6f43429934592ae0d6613dd400065'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.049119 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1199/2401] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:49 2022] DELETE /identity/v3/users/e7c6f43429934592ae0d6613dd400065 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:50.351218 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:50.352804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:50.374922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bdc2b-4ae2-4e14-a3ff-8ab8849a9d89 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:50.440290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:50.440918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.441200 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.441461 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] PATH_INFO: `/v3/projects/77a5c871a099406b8499de8918bc505d` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.442590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a5c871a099406b8499de8918bc505d)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:50.445222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:50.495188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a5c871a099406b8499de8918bc505d', 'request_id': 'req-a5f1ef75-a15c-4860-8268-0e39c170246e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.507145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a5c871a099406b8499de8918bc505d', 'request_id': 'req-a5f1ef75-a15c-4860-8268-0e39c170246e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.513238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:50.519069 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a5c871a099406b8499de8918bc505d', 'request_id': 'req-a5f1ef75-a15c-4860-8268-0e39c170246e'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.535869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] The token cache is being invalidate because project 77a5c871a099406b8499de8918bc505d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:50.536608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.537697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5f1ef75-a15c-4860-8268-0e39c170246e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:50.539634 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1203/2402] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:50 2022] DELETE /identity/v3/projects/77a5c871a099406b8499de8918bc505d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:50.544494 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.544920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.545025 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.566206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:50.567483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:50.637147 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1200/2403] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:50.645966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.646486 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.646582 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.667190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:50.668393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:50.677529 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1204/2404] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:50.681891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:50.688333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:50.696886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002007fc-0996-4a3f-8c08-0e3a6af3dd96 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:50.703943 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:50.705358 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.705645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.705961 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.708084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:07:50.708404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:50.710140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:50.727038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1201/2405] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:07:50.728181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:50.738686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289509c-e21e-424f-b788-004a26a7bde5 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:50.754663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:50.755669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.756116 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.756608 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.757259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:50.759523 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:50.804314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1205/2406] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:50 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:50.805632 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:50.818198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b2bf-371b-41c2-b58a-800bc0285d9e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:50.900175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:50.900854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.901280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.901556 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.902235 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:50.904166 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:50.930814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1202/2407] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:50 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:07:50.934626 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:50.945623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc41c2-dd80-4422-9468-4f7aa2bced30 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:50.950744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:50.951342 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.951769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.952043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.953549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:50.955187 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:50.967560 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1206/2408] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:50.971858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:50.983561 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9d04d-8cee-429f-8da3-d3bdda1a1722 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:50.988641 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13211df-711d-4e46-8205-1d3deb7de019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:50.989248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13211df-711d-4e46-8205-1d3deb7de019 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:50.989517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13211df-711d-4e46-8205-1d3deb7de019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:50.989836 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13211df-711d-4e46-8205-1d3deb7de019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:50.990522 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13211df-711d-4e46-8205-1d3deb7de019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:50.992648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13211df-711d-4e46-8205-1d3deb7de019 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.005788 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1203/2409] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:51.009774 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.019683 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f5bf1-1e0f-407f-bafc-7fce3b352988 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.024971 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.025616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.025921 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.026192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] PATH_INFO: `/v3/projects/1be31d21e274461ab642c405403102d7/users/2d3abe03a9c8453ca410e7b7c97e3675/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.041919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be31d21e274461ab642c405403102d7, user_id=2d3abe03a9c8453ca410e7b7c97e3675, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.044761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.058658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1207/2410] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:51 2022] PUT /identity/v3/projects/1be31d21e274461ab642c405403102d7/users/2d3abe03a9c8453ca410e7b7c97e3675/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:51.069535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.069865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.070141 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.101535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] MFA Rules not processed for user `2d3abe03a9c8453ca410e7b7c97e3675`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:51.102854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:51.183863 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1204/2411] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:51.188749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.274534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd390f-7ecb-43a8-bb7d-cac9052665a4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.279177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.279801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.280082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.280351 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.280976 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.282873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.309806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1208/2412] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:07:51 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:51.313997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.325011 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5695c0-4e0e-46d2-a6b5-d4a121573174 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.380096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.380697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.381525 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.381929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.382555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.384920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.393992 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:51.410110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1205/2413] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:07:51 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:07:51.414357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.424927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d56a3-550b-4f08-88bf-e1f192ac2f97 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.429875 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.430564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.430841 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.431114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.431988 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.433655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.445062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1209/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:07:51.449292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.459929 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75e67-e88c-44d3-b753-1e57706b23d3 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.464524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.465168 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.465449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.465725 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] PATH_INFO: `/v3/projects/aee461ff73434520b5c804bb0ae49b43/users/3b0c559d3aed4a0b9d61a4598dd1753a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.481477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee461ff73434520b5c804bb0ae49b43, user_id=3b0c559d3aed4a0b9d61a4598dd1753a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.484153 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.496898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1206/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:51 2022] PUT /identity/v3/projects/aee461ff73434520b5c804bb0ae49b43/users/3b0c559d3aed4a0b9d61a4598dd1753a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:07:51.500953 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.512045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a013-7909-4319-b0f7-39fd3e6152ec admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.561685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:51.569020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc370-4dc7-4d36-ae08-89fff50b3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.570062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc370-4dc7-4d36-ae08-89fff50b3108 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.570380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc370-4dc7-4d36-ae08-89fff50b3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.570825 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc370-4dc7-4d36-ae08-89fff50b3108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.571637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc370-4dc7-4d36-ae08-89fff50b3108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.573657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc370-4dc7-4d36-ae08-89fff50b3108 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.583279 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1210/2416] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:07:51.588377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.598489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff85511-2394-4a1d-87c7-5b48e2ae4234 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.603139 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.603779 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.604055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.604323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] PATH_INFO: `/v3/projects/aee461ff73434520b5c804bb0ae49b43/users/3b0c559d3aed4a0b9d61a4598dd1753a/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.606242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee461ff73434520b5c804bb0ae49b43, user_id=3b0c559d3aed4a0b9d61a4598dd1753a, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.608865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.618910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1207/2417] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:07:51 2022] PUT /identity/v3/projects/aee461ff73434520b5c804bb0ae49b43/users/3b0c559d3aed4a0b9d61a4598dd1753a/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:51.628762 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.629077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.629351 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.659390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] MFA Rules not processed for user `3b0c559d3aed4a0b9d61a4598dd1753a`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:51.660586 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:51.727876 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1211/2418] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:51.739130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:51.741317 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:51.802483 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1a11-fa4e-4f2d-8fbe-c456221034a2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:51.806974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff2f9-a163-4b6c-805a-a65634376f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:51.807576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff2f9-a163-4b6c-805a-a65634376f50 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:51.807851 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff2f9-a163-4b6c-805a-a65634376f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:51.808145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff2f9-a163-4b6c-805a-a65634376f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:51.863376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff2f9-a163-4b6c-805a-a65634376f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:51.865306 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff2f9-a163-4b6c-805a-a65634376f50 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:51.876001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1208/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:54.528757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:54.542219 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9702ad-eb06-468f-b9d7-1e4732d8508d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:54.546755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:54.547573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:54.548046 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:54.548518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:54.559867 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:54.561456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:54.574140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1212/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:55.504484 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:55.504983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:55.505081 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:55.524342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:55.525506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:55.577564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1209/2421] 10.222.0.16 () {58 vars in 967 bytes} [Thu Oct 20 06:07:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:55.629958 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:55.631873 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:55.701244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce3507-2997-435f-9108-f846db923a36 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:55.706143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773386c0-733d-41a0-9458-7ee015dd0f4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:55.706739 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773386c0-733d-41a0-9458-7ee015dd0f4b service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:55.707013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773386c0-733d-41a0-9458-7ee015dd0f4b service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:55.707281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773386c0-733d-41a0-9458-7ee015dd0f4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:55.715353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773386c0-733d-41a0-9458-7ee015dd0f4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:55.716904 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773386c0-733d-41a0-9458-7ee015dd0f4b service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:55.724663 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1213/2422] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:07:58.188469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:58.190511 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:58.211425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:58.282770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80464-ea24-466c-935a-f84b663d524d None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:58.291203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:58.291777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:58.292053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:58.292321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] PATH_INFO: `/v3/users/8651d6c539264bd3840cb492bfc5aef0` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:58.293456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8651d6c539264bd3840cb492bfc5aef0)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:58.295409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:58.346377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8651d6c539264bd3840cb492bfc5aef0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:58.347157 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8651d6c539264bd3840cb492bfc5aef0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:58.355867 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8651d6c539264bd3840cb492bfc5aef0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:58.357215 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8651d6c539264bd3840cb492bfc5aef0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:58.367986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8651d6c539264bd3840cb492bfc5aef0'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:58.387959 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1210/2423] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:07:58 2022] DELETE /identity/v3/users/8651d6c539264bd3840cb492bfc5aef0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:07:58.392391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:58.393238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:58.393520 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:58.416930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:07:58.418193 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:58.485143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:58.498356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1214/2424] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:07:58.513940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:58.515955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:58.616103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed3ee7-d4e5-44a3-98d0-03c142ff6a51 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:58.624516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:58.625164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:58.625569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:58.625767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:58.639071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:58.640571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:58.652373 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1211/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:07:58.968093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:07:58.970244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:07:58.997252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf590b11-aa40-40b9-a6d8-010f4a1f21f1 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:07:59.005099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:07:59.005935 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:07:59.006344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:07:59.007615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] PATH_INFO: `/v3/projects/2fd7688656824d5db380ef46cfe62cc6` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:07:59.009982 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd7688656824d5db380ef46cfe62cc6)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:07:59.013505 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:07:59.080283 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd7688656824d5db380ef46cfe62cc6', 'request_id': 'req-0c4c3157-c20c-468f-83a1-3fad541c4779'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:59.089975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd7688656824d5db380ef46cfe62cc6', 'request_id': 'req-0c4c3157-c20c-468f-83a1-3fad541c4779'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:59.098264 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd7688656824d5db380ef46cfe62cc6', 'request_id': 'req-0c4c3157-c20c-468f-83a1-3fad541c4779'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:59.112307 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] The token cache is being invalidate because project 2fd7688656824d5db380ef46cfe62cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:07:59.112742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:59.113419 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:07:59.115493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1215/2426] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:07:58 2022] DELETE /identity/v3/projects/2fd7688656824d5db380ef46cfe62cc6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:02.968726 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:02.970322 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:02.985071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286ba3-64ef-4d51-9b4f-84c1d394e60d service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:03.015967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:03.044359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:03.044914 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:03.045193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:03.045466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] PATH_INFO: `/v3/users/875e20a6dfae4e5d8849ded56b4654ac` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:03.046628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] RBAC: Authorizing `identity:delete_user(user_id=875e20a6dfae4e5d8849ded56b4654ac)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:03.048548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:03.094462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875e20a6dfae4e5d8849ded56b4654ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.095055 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875e20a6dfae4e5d8849ded56b4654ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.102270 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875e20a6dfae4e5d8849ded56b4654ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.102928 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875e20a6dfae4e5d8849ded56b4654ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.110121 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875e20a6dfae4e5d8849ded56b4654ac'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.127602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1212/2427] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:08:02 2022] DELETE /identity/v3/users/875e20a6dfae4e5d8849ded56b4654ac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:03.303984 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:03.305963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:03.324789 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3157-c20c-468f-83a1-3fad541c4779 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:03.382807 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:03.383437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:03.383747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:03.384312 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] PATH_INFO: `/v3/projects/bae435faf8024e998996ab6d51b1f559` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:03.385332 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae435faf8024e998996ab6d51b1f559)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:03.387568 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:03.445588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae435faf8024e998996ab6d51b1f559', 'request_id': 'req-7684cee6-6f16-46a9-bb42-b467602b7760'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.452030 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae435faf8024e998996ab6d51b1f559', 'request_id': 'req-7684cee6-6f16-46a9-bb42-b467602b7760'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.462037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae435faf8024e998996ab6d51b1f559', 'request_id': 'req-7684cee6-6f16-46a9-bb42-b467602b7760'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.473056 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] The token cache is being invalidate because project bae435faf8024e998996ab6d51b1f559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:08:03.473341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.473994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.475741 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1216/2428] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:08:03 2022] DELETE /identity/v3/projects/bae435faf8024e998996ab6d51b1f559 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:03.479399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:03.480900 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:03.493957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0d20-7154-440e-94f7-37f46b0f720b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:03.550320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:03.550942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:03.551213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:03.551477 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] PATH_INFO: `/v3/users/04b8fd3626a54356946b3f8b705797b5` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:03.552575 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b8fd3626a54356946b3f8b705797b5)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:03.554535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:03.600113 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b8fd3626a54356946b3f8b705797b5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.600832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b8fd3626a54356946b3f8b705797b5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.606072 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:03.608030 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b8fd3626a54356946b3f8b705797b5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.608938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b8fd3626a54356946b3f8b705797b5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.616423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8f4d3d4b-ce45-4c78-a466-61dee742019f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b8fd3626a54356946b3f8b705797b5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.634303 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1213/2429] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:08:03 2022] DELETE /identity/v3/users/04b8fd3626a54356946b3f8b705797b5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:03.815190 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:03.816909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:03.837433 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cee6-6f16-46a9-bb42-b467602b7760 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:03.843000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:03.901620 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:03.902453 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:03.902794 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:03.903134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] PATH_INFO: `/v3/projects/6a3583154f474084afe39a6165a33042` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:03.904350 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3583154f474084afe39a6165a33042)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:03.906348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:03.955823 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3583154f474084afe39a6165a33042', 'request_id': 'req-106740df-8e1a-45d8-998f-6916ccd25027'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.963100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3583154f474084afe39a6165a33042', 'request_id': 'req-106740df-8e1a-45d8-998f-6916ccd25027'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.972704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3583154f474084afe39a6165a33042', 'request_id': 'req-106740df-8e1a-45d8-998f-6916ccd25027'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.986684 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] The token cache is being invalidate because project 6a3583154f474084afe39a6165a33042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:08:03.987167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.987981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:03.989504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1217/2430] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:08:03 2022] DELETE /identity/v3/projects/6a3583154f474084afe39a6165a33042 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:06.054699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:06.055179 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:06.055296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:06.074161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:06.075357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:06.129602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1214/2431] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:08:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:06.142301 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:06.143685 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:06.213093 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106740df-8e1a-45d8-998f-6916ccd25027 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:06.217970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:06.218571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:06.218848 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:06.219120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:06.227623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:06.229192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:06.237071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1218/2432] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:08:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:08:07.073552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:07.074850 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:07.192853 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf2639-98b2-4c99-84d7-a395a197e0b8 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:07.198651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:07.199448 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:07.199731 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:07.200056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:07.202197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:07.217423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:07.219067 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a861e-8640-46c5-b890-8b2d54f17ed0 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:07.234490 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1215/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:07.608936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:07.610938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:07.653877 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:07.719865 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409cb7-795d-4014-bb34-0ed89e88726a service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:07.724561 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:07.725254 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:07.725573 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:07.726023 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] PATH_INFO: `/v3/users/2d3abe03a9c8453ca410e7b7c97e3675` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:07.727154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3abe03a9c8453ca410e7b7c97e3675)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:07.730954 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:07.794000 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3abe03a9c8453ca410e7b7c97e3675'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:07.805937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3abe03a9c8453ca410e7b7c97e3675'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:07.807094 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3abe03a9c8453ca410e7b7c97e3675'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:07.815441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3abe03a9c8453ca410e7b7c97e3675'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:07.816275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3abe03a9c8453ca410e7b7c97e3675'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:07.849045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1219/2434] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:08:07 2022] DELETE /identity/v3/users/2d3abe03a9c8453ca410e7b7c97e3675 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:07.853685 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:07.854022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:07.854296 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:07.875772 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:07.876998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:07.973773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1216/2435] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:07.984335 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:07.985889 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:08.070853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3913a-bc2d-43d6-adb7-99de6d3e46e1 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:08.074721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:08.075360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:08.075643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:08.075916 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:08.091394 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:08.092845 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:08.103834 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1220/2436] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:08.464737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:08.469203 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:08.478293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:08.485922 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad98e-a5d4-4fda-80aa-737256d6cf4a None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:08.496415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:08.497341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:08.497933 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:08.498354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] PATH_INFO: `/v3/projects/1be31d21e274461ab642c405403102d7` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:08.499996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be31d21e274461ab642c405403102d7)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:08.502449 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:08.564880 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be31d21e274461ab642c405403102d7', 'request_id': 'req-7f5b0810-df12-4042-b12f-748b5b95039b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.573907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be31d21e274461ab642c405403102d7', 'request_id': 'req-7f5b0810-df12-4042-b12f-748b5b95039b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.583777 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be31d21e274461ab642c405403102d7', 'request_id': 'req-7f5b0810-df12-4042-b12f-748b5b95039b'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.600096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] The token cache is being invalidate because project 1be31d21e274461ab642c405403102d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:08:08.600920 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.601585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.604901 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1217/2437] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:08:08 2022] DELETE /identity/v3/projects/1be31d21e274461ab642c405403102d7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:08:08.607895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:08.619549 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5520-922f-48ec-a033-986c83e4265e service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:08.675740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:08.690720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:08.691357 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:08.691628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:08.691897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] PATH_INFO: `/v3/users/3b0c559d3aed4a0b9d61a4598dd1753a` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:08.693032 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0c559d3aed4a0b9d61a4598dd1753a)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:08.695003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:08.758512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0c559d3aed4a0b9d61a4598dd1753a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.767096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0c559d3aed4a0b9d61a4598dd1753a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.768090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0c559d3aed4a0b9d61a4598dd1753a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.779965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0c559d3aed4a0b9d61a4598dd1753a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.780760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-1b8a9337-54c0-4349-b95b-ba63058b12e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0c559d3aed4a0b9d61a4598dd1753a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:08.811054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1221/2438] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:08:08 2022] DELETE /identity/v3/users/3b0c559d3aed4a0b9d61a4598dd1753a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:09.356452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:09.358052 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:09.384980 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b0810-df12-4042-b12f-748b5b95039b admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:09.460957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:09.461399 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.461656 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.461997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] PATH_INFO: `/v3/projects/aee461ff73434520b5c804bb0ae49b43` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.464682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee461ff73434520b5c804bb0ae49b43)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:09.466843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:09.531869 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee461ff73434520b5c804bb0ae49b43', 'request_id': 'req-cbbb0e97-0dea-4870-8804-582828f8aa56'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:09.539080 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee461ff73434520b5c804bb0ae49b43', 'request_id': 'req-cbbb0e97-0dea-4870-8804-582828f8aa56'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:09.547701 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee461ff73434520b5c804bb0ae49b43', 'request_id': 'req-cbbb0e97-0dea-4870-8804-582828f8aa56'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:09.562200 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] The token cache is being invalidate because project aee461ff73434520b5c804bb0ae49b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:08:09.562480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:09.563129 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-cbbb0e97-0dea-4870-8804-582828f8aa56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:09.564658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1218/2439] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:08:09 2022] DELETE /identity/v3/projects/aee461ff73434520b5c804bb0ae49b43 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:09.573427 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.573729 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.574010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.597166 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:09.598393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:09.665837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1222/2440] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:09.677002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.677280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.677552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.702145 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:09.703367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:09.714241 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1219/2441] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:09.718273 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:09.730880 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e76559-858d-434d-a134-0ce1ffb9bae7 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:09.736344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:09.736956 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.737236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.737507 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.738230 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:08:09.738534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:09.740133 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:09.755381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1223/2442] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:08:09.760442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:09.771209 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6f1c-13f0-4529-95f3-26e8e4532ed4 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:09.776481 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:09.777292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.777571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.777887 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.778534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:09.780460 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:09.786426 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:09.816826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1220/2443] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:08:09 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:08:09.823131 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:09.834177 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335207-0b32-40c3-aa45-40d8eba89814 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:09.898164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:09.906731 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:09.907783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.908555 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.911786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.911786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:09.911786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:09.962355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1224/2444] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:08:09 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:08:09.966251 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:09.980079 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc704d-a120-4614-b0d0-52ad6798e580 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:09.996000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:09.996629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:09.996904 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:09.997178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:09.997861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:09.999468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:10.020465 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1221/2445] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:08:10.021981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:10.039220 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86af48-1fbd-4503-93c3-b85c1253354d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:10.044161 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e711f0-f690-44c6-a13a-221986196d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:10.044856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e711f0-f690-44c6-a13a-221986196d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:10.045206 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e711f0-f690-44c6-a13a-221986196d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:10.045551 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e711f0-f690-44c6-a13a-221986196d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:10.046319 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e711f0-f690-44c6-a13a-221986196d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:10.047977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e711f0-f690-44c6-a13a-221986196d0d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:10.062887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1225/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:08:10.066996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:10.078240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2903-5422-4ed6-9374-149390bc191c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:10.083416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:10.084691 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:10.085293 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:10.085603 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] PATH_INFO: `/v3/projects/0d414beb5ac24732994f470b306672ef/users/7b26b6f7673b4e9396404935b215a7ed/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:10.103234 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d414beb5ac24732994f470b306672ef, user_id=7b26b6f7673b4e9396404935b215a7ed, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:10.106294 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:10.125120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1222/2447] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:08:10 2022] PUT /identity/v3/projects/0d414beb5ac24732994f470b306672ef/users/7b26b6f7673b4e9396404935b215a7ed/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:10.138425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:10.139077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:10.139398 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:10.174243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] MFA Rules not processed for user `7b26b6f7673b4e9396404935b215a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:10.174955 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:10.261616 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1226/2448] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:10.269404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:10.271366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:10.349635 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048ed44-bfc2-4c2d-ac07-cfd840adb0db admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:10.355577 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ba769-3b71-4747-8bb7-3e1565bdac0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:10.356332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba769-3b71-4747-8bb7-3e1565bdac0c service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:10.356613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba769-3b71-4747-8bb7-3e1565bdac0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:10.356882 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba769-3b71-4747-8bb7-3e1565bdac0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:10.367723 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba769-3b71-4747-8bb7-3e1565bdac0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:10.369514 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba769-3b71-4747-8bb7-3e1565bdac0c service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:10.381223 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1223/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:20.250120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=40,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:20.376762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:20.579496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:20.580886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:20.636897 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ff43b-d666-4216-8129-399d61dbc566 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:20.640392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:20.640989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:20.641266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:20.641534 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:20.643252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:20.653134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:20.654564 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2c21-e0e7-4dfa-bf11-43f4de5960f5 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:20.662504 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1227/2450] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:20.787380 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402696-facf-4808-9daf-21abcbcfbec0 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:20.787659 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402696-facf-4808-9daf-21abcbcfbec0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:20.787934 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402696-facf-4808-9daf-21abcbcfbec0 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:20.789311 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1224/2451] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 06:08:20.797327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec2b8b-0a0d-4a47-9ae8-510579a19e44 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:20.807580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec2b8b-0a0d-4a47-9ae8-510579a19e44 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:20.807580 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec2b8b-0a0d-4a47-9ae8-510579a19e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:20.826627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-32ec2b8b-0a0d-4a47-9ae8-510579a19e44 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:20.828145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-32ec2b8b-0a0d-4a47-9ae8-510579a19e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:20.915409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1228/2452] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:08:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:08:20.932035 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96402696-facf-4808-9daf-21abcbcfbec0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:20.935416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-96402696-facf-4808-9daf-21abcbcfbec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:21.010619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96402696-facf-4808-9daf-21abcbcfbec0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:21.014843 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4601a-3e49-4538-a15e-2ea6275a30f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a667b7903d5c484e891e69382f6d20e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:21.015637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4601a-3e49-4538-a15e-2ea6275a30f4 service glance] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.016056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4601a-3e49-4538-a15e-2ea6275a30f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.016447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4601a-3e49-4538-a15e-2ea6275a30f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.030618 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4601a-3e49-4538-a15e-2ea6275a30f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:21.032178 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4601a-3e49-4538-a15e-2ea6275a30f4 service glance] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:21.044351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1225/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:21.115013 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c1149-9e86-4974-8537-99d9e2c8485a None None] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.115379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c1149-9e86-4974-8537-99d9e2c8485a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.115569 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c1149-9e86-4974-8537-99d9e2c8485a None None] PATH_INFO: `/` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.117488 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1229/2454] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:08:21.122457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fbc6d-d21b-46d3-a5b5-4799489b1cda None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.122861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fbc6d-d21b-46d3-a5b5-4799489b1cda None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.123265 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fbc6d-d21b-46d3-a5b5-4799489b1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.144171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-d08fbc6d-d21b-46d3-a5b5-4799489b1cda None None] MFA Rules not processed for user `a57b3ec9b66547c0afce59fe21c5feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:21.145461 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-d08fbc6d-d21b-46d3-a5b5-4799489b1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:21.152195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1226/2455] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:08:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:21.164375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c1149-9e86-4974-8537-99d9e2c8485a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:21.166376 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fb4c1149-9e86-4974-8537-99d9e2c8485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:21.181524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c1149-9e86-4974-8537-99d9e2c8485a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:21.185141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa3bd-e249-4f84-8a3a-0ab7bb9248e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:21.185754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa3bd-e249-4f84-8a3a-0ab7bb9248e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.186035 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa3bd-e249-4f84-8a3a-0ab7bb9248e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.186304 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa3bd-e249-4f84-8a3a-0ab7bb9248e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.193544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aa3bd-e249-4f84-8a3a-0ab7bb9248e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:21.195132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aa3bd-e249-4f84-8a3a-0ab7bb9248e0 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:21.202895 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1230/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:21.545785 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215090-c7f5-4c40-ba02-bc08a9e8ca07 None None] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.546279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215090-c7f5-4c40-ba02-bc08a9e8ca07 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.546396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215090-c7f5-4c40-ba02-bc08a9e8ca07 None None] PATH_INFO: `/` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.547667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1227/2457] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 06:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 06:08:21.552557 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.552995 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.553121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.573015 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] MFA Rules not processed for user `6caa2ac059864911ac3d429df74b693e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:21.574261 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:21.583249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1231/2458] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 06:08:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:21.593998 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215090-c7f5-4c40-ba02-bc08a9e8ca07 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:21.604936 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215090-c7f5-4c40-ba02-bc08a9e8ca07 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:21.608421 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:21.609034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.609313 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.609586 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.619491 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:21.620911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:21.631396 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1228/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:21.690424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:21.691836 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:21.759263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a14b3-f745-4dbb-8c24-6e241d4d5286 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:21.764215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:21.764808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:21.765086 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:21.765358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:21.767050 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:21.778168 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:21.779721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445fce3-a303-4ce3-9a0b-f348e61a0d7b service placement] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:21.789548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1232/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:22.067400 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:22.141122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565430e-6884-419b-be60-d8e03b5cac53 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:22.145651 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:22.146309 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.146590 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.146861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] PATH_INFO: `/v3/users/7b26b6f7673b4e9396404935b215a7ed` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.148016 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b26b6f7673b4e9396404935b215a7ed)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:22.150337 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:22.201384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b26b6f7673b4e9396404935b215a7ed'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.202090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b26b6f7673b4e9396404935b215a7ed'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.209112 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b26b6f7673b4e9396404935b215a7ed'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.209767 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b26b6f7673b4e9396404935b215a7ed'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.217644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b26b6f7673b4e9396404935b215a7ed'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.235517 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1229/2461] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:08:22 2022] DELETE /identity/v3/users/7b26b6f7673b4e9396404935b215a7ed => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:22.240003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.240286 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.240558 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.248977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:22.261544 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:22.262786 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:22.324973 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1233/2462] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:22.332507 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:22.334197 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:22.339854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:22.395087 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a0d22-85c7-40b6-b53f-28958baac34d admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:22.398797 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d1ff-955c-4081-98eb-114d773fea62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:22.399893 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d1ff-955c-4081-98eb-114d773fea62 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.400169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d1ff-955c-4081-98eb-114d773fea62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.400440 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d1ff-955c-4081-98eb-114d773fea62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.409357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8d1ff-955c-4081-98eb-114d773fea62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:22.410826 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8d1ff-955c-4081-98eb-114d773fea62 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:22.420616 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1230/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:22.690457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:22.691970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:22.704933 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2ec2-33e4-4f31-a18f-47bf3bfaa3fa None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:22.709773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:22.710411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.710689 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.710963 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] PATH_INFO: `/v3/projects/0d414beb5ac24732994f470b306672ef` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.713084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d414beb5ac24732994f470b306672ef)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:22.715150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:22.768647 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d414beb5ac24732994f470b306672ef', 'request_id': 'req-6be48efe-dbf6-4a26-99ae-6c3ad6711206'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.775485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d414beb5ac24732994f470b306672ef', 'request_id': 'req-6be48efe-dbf6-4a26-99ae-6c3ad6711206'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.783148 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d414beb5ac24732994f470b306672ef', 'request_id': 'req-6be48efe-dbf6-4a26-99ae-6c3ad6711206'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.797888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] The token cache is being invalidate because project 0d414beb5ac24732994f470b306672ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:08:22.798178 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.799012 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6be48efe-dbf6-4a26-99ae-6c3ad6711206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:22.800884 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1234/2464] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:08:22 2022] DELETE /identity/v3/projects/0d414beb5ac24732994f470b306672ef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:22.806889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.807427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.807530 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.827565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:22.828932 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:22.890764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1231/2465] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:22.900266 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.900509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.900791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.921952 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:22.923151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:22.932271 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1235/2466] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:22.936678 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:22.947859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b847-8b53-456e-b4dc-047f44068dec None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:22.952384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:22.952994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.953259 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.953538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.954217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:08:22.954533 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:22.956101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:22.969027 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1232/2467] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:08:22.973236 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:22.987765 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373522c-02dc-4d3b-b39a-6a5319cf299c None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:22.992983 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:22.994253 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:22.994548 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:22.994814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:22.995457 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:22.997384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.029559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1236/2468] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:08:22 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:08:23.032979 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:23.044351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16623-ae90-49be-aed6-2894ea6187dc admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:23.105161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:23.105792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.106075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.106349 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.107034 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:23.108894 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.130840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1233/2469] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:08:23 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:08:23.135494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:23.145846 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d187f-8ee4-407f-91ff-088c45d7ff3c admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:23.150670 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:23.151215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.151497 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.151776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.152421 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:23.154062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.167364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1237/2470] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:08:23.170634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:23.182861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fc59c-2d1b-46b4-8dff-de3943f0c130 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:23.187673 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441592a0-ae6c-4b10-8d2e-7dcf7d6a5eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:23.188278 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441592a0-ae6c-4b10-8d2e-7dcf7d6a5eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.188552 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441592a0-ae6c-4b10-8d2e-7dcf7d6a5eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.188821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441592a0-ae6c-4b10-8d2e-7dcf7d6a5eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.189631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441592a0-ae6c-4b10-8d2e-7dcf7d6a5eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:23.191133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441592a0-ae6c-4b10-8d2e-7dcf7d6a5eb5 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.203457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1234/2471] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:08:23.207414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:23.218424 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf15e8-836c-4fcc-aaf0-7dcbb902a7ac admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:23.226899 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e5f9e-7b43-495b-ac4b-6e977eb8d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:23.227905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e5f9e-7b43-495b-ac4b-6e977eb8d43c admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.228183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e5f9e-7b43-495b-ac4b-6e977eb8d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.228456 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e5f9e-7b43-495b-ac4b-6e977eb8d43c admin admin] PATH_INFO: `/v3/projects/2ea42d253e31450bb9114eeaebbe2a29/users/6d2a69acb6f942a28a86da24087bede5/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.246212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e5f9e-7b43-495b-ac4b-6e977eb8d43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea42d253e31450bb9114eeaebbe2a29, user_id=6d2a69acb6f942a28a86da24087bede5, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:23.248905 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e5f9e-7b43-495b-ac4b-6e977eb8d43c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.263360 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1238/2472] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:08:23 2022] PUT /identity/v3/projects/2ea42d253e31450bb9114eeaebbe2a29/users/6d2a69acb6f942a28a86da24087bede5/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:08:23.273506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.274379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.274614 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.295005 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:23.304195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] MFA Rules not processed for user `6d2a69acb6f942a28a86da24087bede5`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:23.306205 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:23.373651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.374108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.374449 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.376438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1235/2473] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:23.391125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:23.392820 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:23.406135 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:23.407256 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:23.435122 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:23.461108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3be66-a01a-4dfc-a35b-a5d7ad655e10 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:23.465247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:23.465997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.466283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.466551 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.474872 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:23.476292 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1239/2474] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:08:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:08:23.476420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.486320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1236/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:08:23.489344 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:23.490781 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:23.563002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa58233-0ce2-4cd6-91bd-485c8ec7c37d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:23.568233 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcd6c-46fc-47f2-91c3-6da4190e793f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:23.568869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcd6c-46fc-47f2-91c3-6da4190e793f service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:23.569151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcd6c-46fc-47f2-91c3-6da4190e793f service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:23.569438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcd6c-46fc-47f2-91c3-6da4190e793f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:23.578364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebcd6c-46fc-47f2-91c3-6da4190e793f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:23.579942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebcd6c-46fc-47f2-91c3-6da4190e793f service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:23.588044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1240/2476] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:08:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:08:26.183939 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:26.249892 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f8ba-9283-41a0-9898-6da1e7d2a588 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:26.254462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:26.255165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:26.255516 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:26.255862 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] PATH_INFO: `/v3/users/6d2a69acb6f942a28a86da24087bede5` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:26.257488 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2a69acb6f942a28a86da24087bede5)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:26.260351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:26.318675 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:26.321056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2a69acb6f942a28a86da24087bede5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:26.322154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2a69acb6f942a28a86da24087bede5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:26.333967 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2a69acb6f942a28a86da24087bede5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:26.334681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2a69acb6f942a28a86da24087bede5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:26.355010 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2a69acb6f942a28a86da24087bede5'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:26.374838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1237/2477] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:08:26 2022] DELETE /identity/v3/users/6d2a69acb6f942a28a86da24087bede5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:26.379289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:26.379751 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:26.379898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:26.400192 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:26.401379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:26.471802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1241/2478] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:26.482977 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:26.484502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:26.548366 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428d0b2-df72-4a84-aac7-2df58e88a4c6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:26.555160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75514d-ce44-49e9-a5bd-2f83dd0bddbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:26.555160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75514d-ce44-49e9-a5bd-2f83dd0bddbb service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:26.555160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75514d-ce44-49e9-a5bd-2f83dd0bddbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:26.555160 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75514d-ce44-49e9-a5bd-2f83dd0bddbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:26.565602 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75514d-ce44-49e9-a5bd-2f83dd0bddbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:26.567146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75514d-ce44-49e9-a5bd-2f83dd0bddbb service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:26.579318 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1238/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:26.916400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:26.917902 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:26.942162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff92f50-0c77-45bc-8d0b-439346708d88 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:26.973136 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:26.973813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:26.974097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:26.974370 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] PATH_INFO: `/v3/projects/2ea42d253e31450bb9114eeaebbe2a29` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:26.975697 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea42d253e31450bb9114eeaebbe2a29)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:26.981891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.047345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea42d253e31450bb9114eeaebbe2a29', 'request_id': 'req-f58a976e-6839-46f5-823c-c4013240a72a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:27.054045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea42d253e31450bb9114eeaebbe2a29', 'request_id': 'req-f58a976e-6839-46f5-823c-c4013240a72a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:27.056652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:27.064244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea42d253e31450bb9114eeaebbe2a29', 'request_id': 'req-f58a976e-6839-46f5-823c-c4013240a72a'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:27.076909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] The token cache is being invalidate because project 2ea42d253e31450bb9114eeaebbe2a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:08:27.077212 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:27.077964 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f58a976e-6839-46f5-823c-c4013240a72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:08:27.079714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1242/2480] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:08:26 2022] DELETE /identity/v3/projects/2ea42d253e31450bb9114eeaebbe2a29 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:27.084890 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.085355 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.085638 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.106066 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:27.107513 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:27.177467 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1239/2481] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:27.185829 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.186123 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.186397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.207811 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:27.209037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:27.218070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1243/2482] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:27.222636 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.237592 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f6e97-9239-4404-a565-d45c801af5a8 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.243558 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.244401 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.244775 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.245143 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.245938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:08:27.246369 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.248057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.260871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1240/2483] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:08:27.265491 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.276401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3217094-38ee-4f1c-b78e-d3fd2d7b85d4 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.281119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.281727 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.282205 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.282710 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.283526 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.285511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.338733 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1244/2484] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:08:27 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:08:27.342938 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.354334 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c11cd5-54c1-41da-a7ef-99970e94ef8e admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.412193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:27.433075 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.434070 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.434757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.435354 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.436247 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.438528 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.464249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1241/2485] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:08:27 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:08:27.468353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.479675 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4fd44-7655-480f-9d73-5f310db16e51 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.487839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.488445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.488719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.488989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.489635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.491343 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.505989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1245/2486] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:08:27.507175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.517722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d580e6-a6db-4cd5-9276-1f608e5a4ab8 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.522985 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5618-f9fc-4c08-8e24-5eb5e64909f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.523740 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5618-f9fc-4c08-8e24-5eb5e64909f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.524102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5618-f9fc-4c08-8e24-5eb5e64909f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.524102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5618-f9fc-4c08-8e24-5eb5e64909f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.525062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5618-f9fc-4c08-8e24-5eb5e64909f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.526964 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5618-f9fc-4c08-8e24-5eb5e64909f0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.544402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1242/2487] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:08:27.546118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.566215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851f3b-ac01-49ce-95fe-9bd62ec6bf4d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.589031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.589031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.589031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.589031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] PATH_INFO: `/v3/projects/caddeab84c2c4e1c8a11690e0190ff10/users/c2d6ec321e2a4426aad296c70a1bebdf/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.603719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] RBAC: Authorizing `identity:create_grant(project_id=caddeab84c2c4e1c8a11690e0190ff10, user_id=c2d6ec321e2a4426aad296c70a1bebdf, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.606763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.627773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1246/2488] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:08:27 2022] PUT /identity/v3/projects/caddeab84c2c4e1c8a11690e0190ff10/users/c2d6ec321e2a4426aad296c70a1bebdf/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:27.634240 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.634479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.634756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.654747 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:27.655955 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:27.717392 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1243/2489] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:27.728082 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:27.730752 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:27.795716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7700e80-be92-4716-8ed2-ccb44c15191a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:27.800300 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef995-5404-4760-8136-489865736a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:27.801071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef995-5404-4760-8136-489865736a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:27.801296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef995-5404-4760-8136-489865736a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:27.801625 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef995-5404-4760-8136-489865736a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:27.813125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef995-5404-4760-8136-489865736a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:27.814615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef995-5404-4760-8136-489865736a93 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:27.827075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1247/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:30.610665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:30.612895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:30.836540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27a18-adc7-45d2-b60f-aa6b666dec26 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:30.852681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:30.853567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:30.853884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:30.854162 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:30.861305 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:31.003962 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:31.005681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:31.027409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1244/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:32.761199 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:32.761772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:32.761772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:32.791574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] MFA Rules not processed for user `c2d6ec321e2a4426aad296c70a1bebdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:32.792804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:32.860203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1248/2492] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:08:32.864572 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:32.876427 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb866-472b-40ee-844d-1fa06bbf64fd service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:32.880966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:32.881580 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:32.881885 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:32.882161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:32.882994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:32.885307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:32.891154 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:32.917333 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1245/2493] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:08:32 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:08:32.921311 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:32.933306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c400-d632-40fa-93e0-c7e6eac571a5 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:32.941815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:32.998354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:32.998972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:32.999248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:32.999519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:33.000150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:33.002108 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:33.028493 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1249/2494] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:08:32 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:08:33.029647 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:33.041676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dda9d9-5c8f-4adc-8323-b76871b7cab7 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:33.046846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:33.047523 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:33.047861 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:33.048194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:33.048910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:33.050621 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:33.061658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1246/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:08:33.065830 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:33.076678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d939a-08cd-41f2-9687-3933b3c568e3 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:33.081405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:33.082104 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:33.082385 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:33.082662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] PATH_INFO: `/v3/projects/56e4bcfc80ec4147ad340d5286357d9f/users/a201dc2972d1419e9a05fb548759bfd2/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:33.097947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e4bcfc80ec4147ad340d5286357d9f, user_id=a201dc2972d1419e9a05fb548759bfd2, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:33.100806 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:33.113937 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1250/2496] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:08:33 2022] PUT /identity/v3/projects/56e4bcfc80ec4147ad340d5286357d9f/users/a201dc2972d1419e9a05fb548759bfd2/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:33.118386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:33.128405 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb652-c738-4913-b479-562e1bf85e1c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:33.186249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06076f-1029-4610-a4ff-1c282a31c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:33.186871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06076f-1029-4610-a4ff-1c282a31c707 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:33.187188 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06076f-1029-4610-a4ff-1c282a31c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:33.187406 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06076f-1029-4610-a4ff-1c282a31c707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:33.188043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06076f-1029-4610-a4ff-1c282a31c707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:33.189687 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06076f-1029-4610-a4ff-1c282a31c707 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:33.201940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1247/2497] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:08:33.206302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:33.217922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03ceac-1797-4ef4-b7f9-d9022d1727de admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:33.222801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:33.223467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:33.223748 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:33.224017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] PATH_INFO: `/v3/projects/56e4bcfc80ec4147ad340d5286357d9f/users/a201dc2972d1419e9a05fb548759bfd2/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:33.225970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e4bcfc80ec4147ad340d5286357d9f, user_id=a201dc2972d1419e9a05fb548759bfd2, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:33.229506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:33.240127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1251/2498] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:08:33 2022] PUT /identity/v3/projects/56e4bcfc80ec4147ad340d5286357d9f/users/a201dc2972d1419e9a05fb548759bfd2/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:08:37.154489 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0cdc-64ef-44c6-a021-4f20c44304c9 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:37.154970 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0cdc-64ef-44c6-a021-4f20c44304c9 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:37.155230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0cdc-64ef-44c6-a021-4f20c44304c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:37.190886 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-b8af0cdc-64ef-44c6-a021-4f20c44304c9 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:37.192289 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-b8af0cdc-64ef-44c6-a021-4f20c44304c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:37.297422 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1248/2499] 10.222.0.16 () {58 vars in 967 bytes} [Thu Oct 20 06:08:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:08:37.312891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:37.315296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:37.476005 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804b11-ae4c-4c3a-bd21-ca7b0ed5968a admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:37.482037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:37.483726 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:37.484664 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:37.485092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:37.505167 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:37.510618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:37.522437 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1252/2500] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:08:38.030876 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e477ae-240f-4c05-a951-dc623db65a27 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:38.031164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e477ae-240f-4c05-a951-dc623db65a27 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:38.031446 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e477ae-240f-4c05-a951-dc623db65a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:38.081165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-e9e477ae-240f-4c05-a951-dc623db65a27 None None] MFA Rules not processed for user `a201dc2972d1419e9a05fb548759bfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:38.082502 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-e9e477ae-240f-4c05-a951-dc623db65a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:38.205377 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1249/2501] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:38.220878 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:08:38.222356 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:38.305776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:38.339637 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69440c-4508-4a89-a5c2-aaf4515c3e27 service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:08:38.348379 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:08:38.349268 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:38.349871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:38.351211 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:38.416886 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:08:38.418639 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:08:38.427887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1253/2502] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:08:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:08:39.390164 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:08:39.390704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:08:39.390704 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:08:39.397727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:39.418381 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] MFA Rules not processed for user `c2d6ec321e2a4426aad296c70a1bebdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:08:39.420135 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:08:39.427534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1250/2503] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:08:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:08:48.423715 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=32 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:49.409065 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:02.025141 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:02.026595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:02.082181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5368-118c-4aae-b48d-3d7d88379173 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:02.085783 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:02.086386 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:02.086666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:02.086936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:02.096737 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:02.098188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:02.107561 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1254/2504] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:09:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:09:12.103348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=26 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:19.080466 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:19.091002 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903e34-2cb6-4c74-bb90-7b0f8b0fef57 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:19.094965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:19.096442 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:19.096854 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:19.097122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:19.098891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:19.160331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:19.161791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:19.171682 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1251/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:09:22.342546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:22.343991 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:22.358298 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bf2c4-647b-4b6a-86a7-8a9b1e843ba6 service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:22.363785 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:22.364405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:22.364678 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:22.364947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] PATH_INFO: `/v3/users/6b53b2fbfb31429387e68f47f2650403` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:22.366128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b53b2fbfb31429387e68f47f2650403)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:22.368018 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:22.413462 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b53b2fbfb31429387e68f47f2650403'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.420276 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b53b2fbfb31429387e68f47f2650403'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.420932 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b53b2fbfb31429387e68f47f2650403'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.428720 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b53b2fbfb31429387e68f47f2650403'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.429345 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-50310a52-58b3-4fc8-a1c3-dd1da43640e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b53b2fbfb31429387e68f47f2650403'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.445962 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1255/2506] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:09:22 2022] DELETE /identity/v3/users/6b53b2fbfb31429387e68f47f2650403 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:09:22.616185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:22.626175 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd82162-1826-4fb7-8e34-4a4eb31cf376 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:22.686768 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:22.687409 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:22.687737 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:22.688108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] PATH_INFO: `/v3/projects/6d0dd0315bea442e9e651b6581fd75e2` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:22.689254 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0dd0315bea442e9e651b6581fd75e2)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:22.691217 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:22.737033 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0dd0315bea442e9e651b6581fd75e2', 'request_id': 'req-748a25de-567a-41c6-b5b4-49123a1e19a1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.742999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0dd0315bea442e9e651b6581fd75e2', 'request_id': 'req-748a25de-567a-41c6-b5b4-49123a1e19a1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.750084 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0dd0315bea442e9e651b6581fd75e2', 'request_id': 'req-748a25de-567a-41c6-b5b4-49123a1e19a1'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.760770 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] The token cache is being invalidate because project 6d0dd0315bea442e9e651b6581fd75e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:09:22.761059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.761684 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-748a25de-567a-41c6-b5b4-49123a1e19a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:09:22.763423 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1252/2507] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:09:22 2022] DELETE /identity/v3/projects/6d0dd0315bea442e9e651b6581fd75e2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:09:22.768813 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:22.769095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:22.769368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:22.789579 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:09:22.790832 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:22.851796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1256/2508] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:09:22.859864 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:22.860151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:22.860430 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:22.880579 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:09:22.881832 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:22.889846 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1253/2509] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:09:22.894574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:22.904296 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767173-29d8-48cf-811a-cfad233ff791 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:22.908924 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:22.909511 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:22.909815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:22.910084 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:22.910719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:09:22.911017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:22.912594 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:22.924138 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1257/2510] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:09:22.928386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:22.937520 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730b24a-74fd-4c57-a450-43d6ff650fc1 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:22.942921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:22.943515 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:22.943789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:22.944057 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:22.944677 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:22.946639 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:22.962709 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:22.979839 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1254/2511] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:09:22 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:09:22.980979 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:22.991334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d99fc6-3efa-4a2d-a5be-07591041ac5e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:23.047140 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:23.047742 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:23.048020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:23.048702 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:23.049329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:23.051329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:23.059118 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:23.075355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1258/2512] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:09:22 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:09:23.080429 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:23.090952 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d159f-eed8-47ee-8f86-2ea423659b09 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:23.095645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:23.096274 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:23.096582 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:23.096884 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:23.097529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:23.099169 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:23.109163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1255/2513] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:09:23.113441 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:23.123150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a90cb5-0096-4437-911f-bbe4c90784f4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:23.128541 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294ea8f-77d1-47f2-b8b3-9327f78c834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:23.129121 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ea8f-77d1-47f2-b8b3-9327f78c834c admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:23.129397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ea8f-77d1-47f2-b8b3-9327f78c834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:23.129666 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ea8f-77d1-47f2-b8b3-9327f78c834c admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:23.130349 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294ea8f-77d1-47f2-b8b3-9327f78c834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:23.131919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294ea8f-77d1-47f2-b8b3-9327f78c834c admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:23.143282 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1259/2514] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:09:23.147255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:23.156981 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc1a8c-dccf-4ae6-a9b4-2a20fbd4445c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:23.161990 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:23.162631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:23.162911 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:23.163186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] PATH_INFO: `/v3/projects/a34a7307f85c4f86a2a23e82e2054068/users/f4ca70decd6042c1a9b29d61c9434c54/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:23.178486 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34a7307f85c4f86a2a23e82e2054068, user_id=f4ca70decd6042c1a9b29d61c9434c54, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:23.181124 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:23.194732 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1256/2515] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:09:23 2022] PUT /identity/v3/projects/a34a7307f85c4f86a2a23e82e2054068/users/f4ca70decd6042c1a9b29d61c9434c54/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:09:23.199839 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08880637-ebb9-4a32-ad09-2e11409d43f2 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:23.200125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08880637-ebb9-4a32-ad09-2e11409d43f2 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:23.200402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08880637-ebb9-4a32-ad09-2e11409d43f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:23.219721 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-08880637-ebb9-4a32-ad09-2e11409d43f2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:09:23.220914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-08880637-ebb9-4a32-ad09-2e11409d43f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:23.277401 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1260/2516] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:09:23.287092 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:23.288727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:23.344649 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d86dd-c02a-43e0-ab3f-47d4d6903636 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:23.348321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:23.348915 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:23.349198 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:23.349473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:23.358286 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:23.359764 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:23.369527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1257/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:09:27.279494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b01b0-1813-414f-8db7-24f44e58375c None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:27.279909 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b01b0-1813-414f-8db7-24f44e58375c None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:27.280062 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b01b0-1813-414f-8db7-24f44e58375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:27.313127 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-2e2b01b0-1813-414f-8db7-24f44e58375c None None] MFA Rules not processed for user `f4ca70decd6042c1a9b29d61c9434c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:09:27.314787 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-2e2b01b0-1813-414f-8db7-24f44e58375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:27.382636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1261/2518] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:09:27.397598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:27.402106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:27.485076 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99887801-561d-4d1a-8514-e3747d0110c8 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:27.491492 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:27.492099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:27.492397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:27.492665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:27.500924 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:27.502774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:27.513312 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1258/2519] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:09:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:09:28.854711 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:28.855213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:28.855314 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:28.874833 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] MFA Rules not processed for user `f4ca70decd6042c1a9b29d61c9434c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:09:28.876547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:28.883707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1262/2520] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:09:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:09:29.201323 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:29.202795 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:29.215275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c913ca5-b0e6-4f0e-ad3f-1f28fba96aa9 service nova] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:29.218931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:29.219527 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:29.219810 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:29.220077 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:29.221824 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:29.231146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:29.232569 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:29.241688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1259/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:09:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 06:09:38.870075 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:39.237724 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:41.196657 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:09:41.198242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:41.214272 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1766a5f-d91a-4f3b-a9a7-5621a052a44f None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:09:41.219655 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:09:41.220883 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:09:41.221235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:09:41.221506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:09:41.223225 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:09:41.235382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:09:41.237036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e3ae0-1d22-4e56-bf00-54d44d02e42a service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:09:41.247667 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1263/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:09:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:09:51.243214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=6 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:12.817766 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:10:12.819211 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:10:12.967631 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455cece-cce1-441f-ae23-1cfc32fdb924 service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:10:12.973146 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:10:12.973978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:10:12.974341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:10:12.974617 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:10:12.976329 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:10:12.989326 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:10:12.990942 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804c85f-0cb6-4ba6-9d3f-7471241b7137 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:10:13.000818 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1260/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:10:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:10:16.046355 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:10:16.046804 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:10:16.046965 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:10:16.066080 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] MFA Rules not processed for user `f4ca70decd6042c1a9b29d61c9434c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:10:16.067262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:10:16.073942 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1264/2524] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:10:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:10:22.996554 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=63 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:26.060713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:16.138960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:11:16.139510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:11:16.139510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:11:16.159212 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] MFA Rules not processed for user `f4ca70decd6042c1a9b29d61c9434c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:11:16.160397 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:11:16.167036 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1261/2525] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:11:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:11:26.153438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:04.412907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:04.414473 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:04.491239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ce64d-1ae4-4abc-9385-730b4d3eecea None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:04.494898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:04.495494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:04.495769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:04.496037 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:04.497732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:04.530048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:04.531466 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9df9-c36d-45e1-b2cb-e3b3b88ab1d5 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:04.551607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1265/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:12:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:12:05.997838 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:05.999242 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:06.011699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee62514-d03a-444b-b4ec-366769f7a5ec None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:06.015189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:06.015780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:06.016056 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:06.016325 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:06.017993 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:06.031654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:06.033064 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:06.045059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1262/2527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:12:13.006559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:13.007169 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:13.007281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:13.028447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] MFA Rules not processed for user `f4ca70decd6042c1a9b29d61c9434c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:12:13.029652 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:13.039407 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1266/2528] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:12:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:12:16.040044 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=6 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:23.023150 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=50 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:45.176935 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:45.179757 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:45.197099 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01005c-1ede-4976-b01b-be0f6ea492d8 service cinder] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:45.203114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:45.203816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:45.204165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:45.204510 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:45.206462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:45.221456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:45.223733 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:45.234414 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:45.237614 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:45.247283 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1263/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:12:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:12:45.290024 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1f18-fd09-40a3-b6c9-5f4962e8a452 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:45.294506 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:45.295115 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:45.295390 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:45.295659 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] PATH_INFO: `/v3/users/c2d6ec321e2a4426aad296c70a1bebdf` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:45.297025 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d6ec321e2a4426aad296c70a1bebdf)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:45.298957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:45.344812 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d6ec321e2a4426aad296c70a1bebdf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.352184 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d6ec321e2a4426aad296c70a1bebdf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.352843 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d6ec321e2a4426aad296c70a1bebdf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.360020 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d6ec321e2a4426aad296c70a1bebdf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.360888 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d6ec321e2a4426aad296c70a1bebdf'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.378618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1267/2530] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:12:45 2022] DELETE /identity/v3/users/c2d6ec321e2a4426aad296c70a1bebdf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 06:12:45.550512 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:45.561565 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb49f0-b12c-4bd8-a8f9-9968ea08e140 service placement] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:45.621003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:45.621628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:45.621973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:45.622249 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] PATH_INFO: `/v3/projects/caddeab84c2c4e1c8a11690e0190ff10` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:45.623424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=caddeab84c2c4e1c8a11690e0190ff10)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:45.625326 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:45.673666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caddeab84c2c4e1c8a11690e0190ff10', 'request_id': 'req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.680301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caddeab84c2c4e1c8a11690e0190ff10', 'request_id': 'req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.688384 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caddeab84c2c4e1c8a11690e0190ff10', 'request_id': 'req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.699281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] The token cache is being invalidate because project caddeab84c2c4e1c8a11690e0190ff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:12:45.699566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.700279 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.701859 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1264/2531] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:12:45 2022] DELETE /identity/v3/projects/caddeab84c2c4e1c8a11690e0190ff10 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:12:45.705869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:45.707336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:45.721097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712168-6c73-473a-87f5-94842063b5fb admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:45.776536 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:45.777154 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:45.777429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:45.777701 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] PATH_INFO: `/v3/users/a201dc2972d1419e9a05fb548759bfd2` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:45.778835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a201dc2972d1419e9a05fb548759bfd2)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:45.780716 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:45.825500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:45.827308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a201dc2972d1419e9a05fb548759bfd2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.835384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a201dc2972d1419e9a05fb548759bfd2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.836119 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a201dc2972d1419e9a05fb548759bfd2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.843194 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a201dc2972d1419e9a05fb548759bfd2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.843796 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a201dc2972d1419e9a05fb548759bfd2'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:45.861310 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1268/2532] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:12:45 2022] DELETE /identity/v3/users/a201dc2972d1419e9a05fb548759bfd2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:12:46.034123 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:12:46.036195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:12:46.050043 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6860f-e57a-4554-b3b7-d00d2673ccbb admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:12:46.107156 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:12:46.107784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:12:46.108063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:12:46.108335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] PATH_INFO: `/v3/projects/56e4bcfc80ec4147ad340d5286357d9f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:12:46.109447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e4bcfc80ec4147ad340d5286357d9f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:12:46.111385 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:12:46.133648 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:46.159931 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e4bcfc80ec4147ad340d5286357d9f', 'request_id': 'req-8520a78d-e0a6-47d9-82a6-482daddb619a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:46.166784 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e4bcfc80ec4147ad340d5286357d9f', 'request_id': 'req-8520a78d-e0a6-47d9-82a6-482daddb619a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:46.173944 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e4bcfc80ec4147ad340d5286357d9f', 'request_id': 'req-8520a78d-e0a6-47d9-82a6-482daddb619a'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:46.183979 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] The token cache is being invalidate because project 56e4bcfc80ec4147ad340d5286357d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:12:46.184568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:46.184895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:12:46.186367 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1265/2533] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:12:46 2022] DELETE /identity/v3/projects/56e4bcfc80ec4147ad340d5286357d9f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:12:55.857791 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=13,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:56.181114 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:04.872496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:04.874740 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:04.992214 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48872c-571e-47aa-bda0-e47ecf57c7c2 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:05.080603 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:05.081174 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:05.081627 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:05.081970 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:05.085381 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:05.097134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:05.099291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:05.110175 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1269/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:12.876681 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:12.878150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:12.953275 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:12.956158 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:12.970219 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a78d-e0a6-47d9-82a6-482daddb619a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:12.976316 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:12.976930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:12.977498 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:12.977965 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:12.984937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:12.999695 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.001524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.013951 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1266/2535] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:13.033208 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e7ea-50d5-4f57-a847-e1ae46d69b44 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.038572 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.039210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.039914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.039914 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] PATH_INFO: `/v3/users/f4ca70decd6042c1a9b29d61c9434c54` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.040856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ca70decd6042c1a9b29d61c9434c54)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.042798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.071588 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:13.090713 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ca70decd6042c1a9b29d61c9434c54'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.097373 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ca70decd6042c1a9b29d61c9434c54'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.098097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ca70decd6042c1a9b29d61c9434c54'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.105181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ca70decd6042c1a9b29d61c9434c54'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.106510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-ed4551ad-e8a2-4a5c-850c-909d25598b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ca70decd6042c1a9b29d61c9434c54'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.125380 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1270/2536] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:12 2022] DELETE /identity/v3/users/f4ca70decd6042c1a9b29d61c9434c54 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:13.300151 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.312604 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494d92-6b95-40bb-9161-333312d17247 service placement] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.373796 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.374524 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.374871 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.375213 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] PATH_INFO: `/v3/projects/a34a7307f85c4f86a2a23e82e2054068` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.376411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34a7307f85c4f86a2a23e82e2054068)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.378416 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.428260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34a7307f85c4f86a2a23e82e2054068', 'request_id': 'req-e5779e4f-a809-40b6-bd98-90e6655aa175'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.434359 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34a7307f85c4f86a2a23e82e2054068', 'request_id': 'req-e5779e4f-a809-40b6-bd98-90e6655aa175'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.442438 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34a7307f85c4f86a2a23e82e2054068', 'request_id': 'req-e5779e4f-a809-40b6-bd98-90e6655aa175'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.452715 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] The token cache is being invalidate because project a34a7307f85c4f86a2a23e82e2054068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:13.453003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.453625 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e5779e4f-a809-40b6-bd98-90e6655aa175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:13.455125 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1267/2537] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:13 2022] DELETE /identity/v3/projects/a34a7307f85c4f86a2a23e82e2054068 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:13.460232 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.460519 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.460797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.518392 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:13.519517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:13.582810 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1271/2538] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:13.590433 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.590720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.590994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.612300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:13.614128 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:13.622231 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1268/2539] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:13.626512 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.636361 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2618efe-8c7c-493b-9d9a-c162344a964e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.640849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.641474 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.641763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.642048 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.642691 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:13:13.642977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.644553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.658777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1272/2540] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:13:13.663760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.673654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2585-44e4-4a5a-b1da-1372a6d70f2a None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.679457 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.680062 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.680342 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.680613 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.681271 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.683196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.694986 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:13.720688 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1269/2541] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:13:13 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:13.725336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.735147 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82cd75-a703-49a8-bbed-5f34bf539610 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.792464 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.792990 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.793267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.793547 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.794224 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.796120 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.804436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:13.819036 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1273/2542] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:13:13 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:13.823281 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.834609 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fea0c-d747-4edc-ba24-cd2662ff63fb admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.839150 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.839744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.840022 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.840292 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.840923 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.842548 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.853808 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1270/2543] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:13.857732 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.867770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6923ab-f9e0-4b0b-9280-7196c4921dd8 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.872338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de9adb-a392-4518-8522-82ba9ccb64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.872930 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de9adb-a392-4518-8522-82ba9ccb64b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.873195 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de9adb-a392-4518-8522-82ba9ccb64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.873463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de9adb-a392-4518-8522-82ba9ccb64b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.874124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de9adb-a392-4518-8522-82ba9ccb64b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.875692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de9adb-a392-4518-8522-82ba9ccb64b7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.887628 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1274/2544] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:13.890971 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:13.901469 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32369780-ab93-4c0e-84d7-798f792c9ee2 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:13.905999 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:13.906634 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.906907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.907173 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] PATH_INFO: `/v3/projects/9046e93f788a45b3be996768e5197e61/users/b49a352f9ff5417592e84998e3c0a0ff/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.921756 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9046e93f788a45b3be996768e5197e61, user_id=b49a352f9ff5417592e84998e3c0a0ff, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:13.924378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:13.938136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1271/2545] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:13 2022] PUT /identity/v3/projects/9046e93f788a45b3be996768e5197e61/users/b49a352f9ff5417592e84998e3c0a0ff/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:13.949109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:13.949395 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:13.949692 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:13.978222 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] MFA Rules not processed for user `b49a352f9ff5417592e84998e3c0a0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:13.979490 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:14.043202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1275/2546] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:14.054015 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:14.055655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:14.110816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3bb5-3641-4611-b9be-01351c54e908 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:14.114508 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e42bc2-632f-42cb-a219-d2954a04c166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:14.115103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e42bc2-632f-42cb-a219-d2954a04c166 service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:14.115379 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e42bc2-632f-42cb-a219-d2954a04c166 service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:14.115644 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e42bc2-632f-42cb-a219-d2954a04c166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:14.123722 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e42bc2-632f-42cb-a219-d2954a04c166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:14.125170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e42bc2-632f-42cb-a219-d2954a04c166 service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:14.134170 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1272/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:22.486871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:22.550591 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a4de6-ffe0-4bd3-ad2b-8e60627788a0 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:22.556064 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:22.556693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:22.556974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:22.557249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] PATH_INFO: `/v3/users/b49a352f9ff5417592e84998e3c0a0ff` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:22.558425 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49a352f9ff5417592e84998e3c0a0ff)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:22.560382 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:22.608531 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49a352f9ff5417592e84998e3c0a0ff'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:22.615730 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49a352f9ff5417592e84998e3c0a0ff'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:22.616399 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49a352f9ff5417592e84998e3c0a0ff'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:22.623241 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49a352f9ff5417592e84998e3c0a0ff'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:22.624002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49a352f9ff5417592e84998e3c0a0ff'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:22.629574 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:22.647309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1276/2548] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:22 2022] DELETE /identity/v3/users/b49a352f9ff5417592e84998e3c0a0ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:22.651762 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:22.652253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:22.652378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:22.670833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:22.672017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:22.728847 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1273/2549] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:22.739228 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:22.740662 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:22.816383 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04027-cdf4-4ff3-b465-dd7c6d282e1d admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:22.820487 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0526-0eac-4581-a522-75165d65ab64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:22.821077 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0526-0eac-4581-a522-75165d65ab64 service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:22.821348 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0526-0eac-4581-a522-75165d65ab64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:22.821618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0526-0eac-4581-a522-75165d65ab64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:22.830798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c0526-0eac-4581-a522-75165d65ab64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:22.832217 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c0526-0eac-4581-a522-75165d65ab64 service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:22.842514 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1277/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:23.117370 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.118816 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:23.131549 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b8c76-dc49-40ec-94fe-fdd3c69346f4 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.136102 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.136729 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.137003 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.137269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] PATH_INFO: `/v3/projects/9046e93f788a45b3be996768e5197e61` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.138388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9046e93f788a45b3be996768e5197e61)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.140280 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.184780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:23.187741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9046e93f788a45b3be996768e5197e61', 'request_id': 'req-f7f354ab-bf45-43db-a784-dbce0759eb64'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:23.195335 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9046e93f788a45b3be996768e5197e61', 'request_id': 'req-f7f354ab-bf45-43db-a784-dbce0759eb64'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:23.202806 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9046e93f788a45b3be996768e5197e61', 'request_id': 'req-f7f354ab-bf45-43db-a784-dbce0759eb64'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:23.213693 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] The token cache is being invalidate because project 9046e93f788a45b3be996768e5197e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:23.214009 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:23.214629 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-f7f354ab-bf45-43db-a784-dbce0759eb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:23.216115 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1274/2551] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:23 2022] DELETE /identity/v3/projects/9046e93f788a45b3be996768e5197e61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:23.221002 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.221288 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.221563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.242281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:23.243387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:23.300744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1278/2552] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:13:23.309131 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.309415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.309697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.329521 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:23.330821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:23.338689 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1275/2553] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:23.342744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.352856 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646fd3-674e-4106-9895-d0aa08e0450a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.357291 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.357927 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.358203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.358467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.359097 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:13:23.359391 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.360957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.373327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1279/2554] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:13:23.377624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.387256 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868b52f-6121-4602-ba07-ffe6ea1665f2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.391794 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.392383 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.392666 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.392937 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.393571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.395495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.422378 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1276/2555] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:23.426447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.436747 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858edc-360d-411d-b6b9-e1b4f7ef4b87 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.486430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:23.493938 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.494518 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.494743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.495009 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.495635 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.497516 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.518259 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1280/2556] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:23.522504 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.532597 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d92e-8d5e-41d3-acde-f97a0188941f admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.537831 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.538424 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.538700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.539001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.539633 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.541206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.551130 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1277/2557] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:23.555618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.566043 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02add2-c7cf-4936-af00-e29c2b7156df admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.571151 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc711-cd67-4b6f-a968-d147f0cd6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.571860 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc711-cd67-4b6f-a968-d147f0cd6e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.572189 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc711-cd67-4b6f-a968-d147f0cd6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.572500 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc711-cd67-4b6f-a968-d147f0cd6e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.573290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc711-cd67-4b6f-a968-d147f0cd6e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.575017 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc711-cd67-4b6f-a968-d147f0cd6e38 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.585510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1281/2558] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:13:23.589434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.599595 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c73c51-4a58-4b29-8c84-29c396cb75a6 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.604161 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.604791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.605071 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.605341 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] PATH_INFO: `/v3/projects/55726fe35f4d417c8b5721110a65394a/users/b0a73a0ee582406eaa5d0f227b31b705/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.620176 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55726fe35f4d417c8b5721110a65394a, user_id=b0a73a0ee582406eaa5d0f227b31b705, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.622811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.635191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1278/2559] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:23 2022] PUT /identity/v3/projects/55726fe35f4d417c8b5721110a65394a/users/b0a73a0ee582406eaa5d0f227b31b705/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:23.646143 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.646429 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.646696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.674171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] MFA Rules not processed for user `b0a73a0ee582406eaa5d0f227b31b705`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:23.675369 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:23.737003 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1282/2560] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:23.741905 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.805468 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8fba-17a8-4bf8-be81-34e7610924c0 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.809982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.810589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.810848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.811117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.811741 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.813624 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.842171 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1279/2561] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:23.845636 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.856862 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d7f1e-52f8-4e09-b604-7c4b0f12675e None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.910808 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.911974 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.912244 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.912510 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.913134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.915038 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.938416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1283/2562] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:13:23 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:13:23.939674 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.950039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508188-0942-494d-bddd-e2dbdc2085ce admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.954615 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.955233 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.955509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.955780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:23.956415 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:23.958557 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:23.969039 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1280/2563] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:23.973235 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:23.984031 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223531f3-733d-4385-ba2d-55ce7dadc298 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:23.990226 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:23.990896 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:23.991172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:23.991445 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] PATH_INFO: `/v3/projects/ad537e6f74ae4c619e1eca2db06c5221/users/6eda30366685498388948c3a10a16330/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:24.006799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad537e6f74ae4c619e1eca2db06c5221, user_id=6eda30366685498388948c3a10a16330, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:24.009430 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:24.022818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1284/2564] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:23 2022] PUT /identity/v3/projects/ad537e6f74ae4c619e1eca2db06c5221/users/6eda30366685498388948c3a10a16330/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:24.027204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:24.037815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378f18d-13be-47b6-9417-3373d2144121 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:24.077264 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:24.094122 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a46ee3-7abf-4e0b-9d48-a111b7cc2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:24.094720 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a46ee3-7abf-4e0b-9d48-a111b7cc2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:24.094994 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a46ee3-7abf-4e0b-9d48-a111b7cc2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:24.095262 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a46ee3-7abf-4e0b-9d48-a111b7cc2bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:24.095888 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a46ee3-7abf-4e0b-9d48-a111b7cc2bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:24.097462 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a46ee3-7abf-4e0b-9d48-a111b7cc2bd4 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:24.106963 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1281/2565] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 06:13:24.111079 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:24.121442 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210015-8bb9-4b69-9b50-fc8c392ff0aa admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:24.126051 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:24.126703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:24.126977 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:24.127294 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] PATH_INFO: `/v3/projects/ad537e6f74ae4c619e1eca2db06c5221/users/6eda30366685498388948c3a10a16330/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:24.129202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad537e6f74ae4c619e1eca2db06c5221, user_id=6eda30366685498388948c3a10a16330, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:24.132397 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:24.142340 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1285/2566] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:24 2022] PUT /identity/v3/projects/ad537e6f74ae4c619e1eca2db06c5221/users/6eda30366685498388948c3a10a16330/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:24.204898 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:24.205181 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:24.205453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:24.233540 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] MFA Rules not processed for user `6eda30366685498388948c3a10a16330`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:24.234760 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:24.299830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1282/2567] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:24.311413 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:24.313095 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:24.335363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:24.373584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172480a7-2b2e-49d9-969e-336d9e19134e admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:24.377479 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:24.378109 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:24.378387 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:24.378658 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:24.389289 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:24.390728 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:24.399947 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1286/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:24.475532 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:24.485189 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab80121-e3bd-4985-9be7-6a173d56cdae None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:24.488883 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a182-d9ef-42e5-83ce-cc8746cd538b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:24.490485 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a182-d9ef-42e5-83ce-cc8746cd538b service cinder] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:24.490774 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a182-d9ef-42e5-83ce-cc8746cd538b service cinder] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:24.491050 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a182-d9ef-42e5-83ce-cc8746cd538b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:24.548645 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a182-d9ef-42e5-83ce-cc8746cd538b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:24.550101 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a182-d9ef-42e5-83ce-cc8746cd538b service cinder] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:24.559185 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1283/2569] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:27.276327 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:27.341183 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008cd3a-ce68-423e-95e0-f42f3ebf7369 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:27.345651 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:27.346309 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:27.346595 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:27.346871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] PATH_INFO: `/v3/users/b0a73a0ee582406eaa5d0f227b31b705` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:27.347994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a73a0ee582406eaa5d0f227b31b705)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:27.350818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:27.397054 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a73a0ee582406eaa5d0f227b31b705'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.404088 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a73a0ee582406eaa5d0f227b31b705'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.404744 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a73a0ee582406eaa5d0f227b31b705'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.412451 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a73a0ee582406eaa5d0f227b31b705'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.413181 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a73a0ee582406eaa5d0f227b31b705'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.430485 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1287/2570] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:27 2022] DELETE /identity/v3/users/b0a73a0ee582406eaa5d0f227b31b705 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:27.435133 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:27.435622 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:27.435745 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:27.454598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:27.455792 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:27.513202 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1284/2571] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:27.523358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:27.524766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:27.568869 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:27.584010 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3862fb8-754b-4460-ab0b-85bc7df68eab admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:27.587644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:27.588242 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:27.588517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:27.588788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:27.597704 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:27.599231 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:27.608537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1288/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:27.873830 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:27.875214 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:27.884589 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=100 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:27.888653 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93edb6-f707-4a2c-b165-2483d8698b08 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:27.893670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:27.894332 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:27.894608 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:27.895425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] PATH_INFO: `/v3/projects/55726fe35f4d417c8b5721110a65394a` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:27.897269 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55726fe35f4d417c8b5721110a65394a)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:27.899218 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:27.947297 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55726fe35f4d417c8b5721110a65394a', 'request_id': 'req-c4761216-78b3-40c6-97fb-b68360fb9284'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.953479 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55726fe35f4d417c8b5721110a65394a', 'request_id': 'req-c4761216-78b3-40c6-97fb-b68360fb9284'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.962224 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55726fe35f4d417c8b5721110a65394a', 'request_id': 'req-c4761216-78b3-40c6-97fb-b68360fb9284'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.973020 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] The token cache is being invalidate because project 55726fe35f4d417c8b5721110a65394a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:27.973310 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.973960 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:27.975545 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1285/2573] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:27 2022] DELETE /identity/v3/projects/55726fe35f4d417c8b5721110a65394a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:27.979615 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:27.989239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d3ac-460e-487a-aacc-acea9730fb0c service neutron] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.046008 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.046553 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.046831 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.047100 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] PATH_INFO: `/v3/users/6eda30366685498388948c3a10a16330` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.048258 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eda30366685498388948c3a10a16330)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.050186 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.094772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eda30366685498388948c3a10a16330'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.102400 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eda30366685498388948c3a10a16330'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.103047 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eda30366685498388948c3a10a16330'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.110096 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eda30366685498388948c3a10a16330'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.110705 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-f6824974-4b69-47d0-b9ad-f9be0b826e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eda30366685498388948c3a10a16330'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.127612 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1289/2574] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:27 2022] DELETE /identity/v3/users/6eda30366685498388948c3a10a16330 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:28.403790 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.405255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:28.426857 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4761216-78b3-40c6-97fb-b68360fb9284 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.484136 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.484841 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.485028 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.485300 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] PATH_INFO: `/v3/projects/ad537e6f74ae4c619e1eca2db06c5221` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.486420 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad537e6f74ae4c619e1eca2db06c5221)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.488320 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.534555 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad537e6f74ae4c619e1eca2db06c5221', 'request_id': 'req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.541248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad537e6f74ae4c619e1eca2db06c5221', 'request_id': 'req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.548637 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad537e6f74ae4c619e1eca2db06c5221', 'request_id': 'req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.559814 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] The token cache is being invalidate because project ad537e6f74ae4c619e1eca2db06c5221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:28.560104 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.560742 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-e6cbf9ae-36ea-4c28-ae23-ec4d675f9277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:28.562248 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1286/2575] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:28 2022] DELETE /identity/v3/projects/ad537e6f74ae4c619e1eca2db06c5221 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:28.567262 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.567749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.567749 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.587338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:28.588542 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:28.646849 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1290/2576] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:28.654568 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.654845 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.655117 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.674930 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:28.676106 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:28.684571 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1287/2577] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:28.688703 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.693604 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:28.700269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b43a5-5060-4bdd-a568-3a458191c17a None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.705601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.706297 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.706571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.706837 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.707508 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:13:28.707802 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.709571 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.720777 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1291/2578] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 06:13:28.725713 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.734912 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e77596-8a81-4d87-985c-e11410d8ce3c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.739538 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.740791 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.741073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.741351 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.742019 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.743926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.753186 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:28.773661 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1288/2579] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:13:28 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:28.778041 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.789124 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311951-a80f-4c37-bc0a-90c0ba2808ed admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.846083 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.846618 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.846893 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.847164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.847799 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.850267 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.871989 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1292/2580] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:13:28 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:28.876110 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.886626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5df0-bdc8-4156-810b-8db630b7aa8a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.891255 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.891858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.892140 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.892413 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.893054 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.894700 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.904956 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1289/2581] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:28.908632 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.919249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488322a-dba9-42e5-9ebf-bdfa160a13ca admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.923743 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd17ec9-47a8-4d09-915a-d3bb16823937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.924324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17ec9-47a8-4d09-915a-d3bb16823937 admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.924599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17ec9-47a8-4d09-915a-d3bb16823937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.924870 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17ec9-47a8-4d09-915a-d3bb16823937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.925496 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd17ec9-47a8-4d09-915a-d3bb16823937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.927092 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd17ec9-47a8-4d09-915a-d3bb16823937 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.937707 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1293/2582] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:28.941495 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:28.952230 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6217-9d98-4fad-a671-70fd7e2f44cc admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:28.957046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:28.957855 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:28.958137 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:28.958411 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] PATH_INFO: `/v3/projects/fde98ac6167444fba33c5f2ee0e406bc/users/2344db79e2a843aba5d00c3e444bf3b8/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:28.974865 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde98ac6167444fba33c5f2ee0e406bc, user_id=2344db79e2a843aba5d00c3e444bf3b8, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:28.977473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:28.990858 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1290/2583] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:28 2022] PUT /identity/v3/projects/fde98ac6167444fba33c5f2ee0e406bc/users/2344db79e2a843aba5d00c3e444bf3b8/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:29.000644 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.000925 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.001198 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.028815 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] MFA Rules not processed for user `2344db79e2a843aba5d00c3e444bf3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:29.030045 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:29.091556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1294/2584] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:29.095978 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.156308 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692aefd-1152-4b4e-8fa7-95b2dbe94633 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.160811 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.161404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.162301 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.162578 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.163206 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.165095 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.190391 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1291/2585] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:13:29 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:29.194590 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.207076 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9aa43-acee-401b-ba00-2a7b94800140 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.257559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:29.264640 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.265248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.265524 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.265826 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] PATH_INFO: `/v3/users` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.266467 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.268375 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.289854 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1295/2586] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:13:29 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:29.293827 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.303983 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c03a-33ea-4b4c-8afc-c556d1b691ff admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.308550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.309148 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.309425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.309697 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.310357 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.311940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.322676 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1292/2587] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:29.326563 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.336898 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3fcb9-d8b5-4ab5-9dbb-c675de12b411 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.341447 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.342128 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.342402 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.342686 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] PATH_INFO: `/v3/projects/6ade4d59d3b249ba93f8ba5cf15d15a2/users/6b6952a41eff4aa7ba9cbabdb482ffd8/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.358431 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ade4d59d3b249ba93f8ba5cf15d15a2, user_id=6b6952a41eff4aa7ba9cbabdb482ffd8, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.361090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.373621 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1296/2588] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:29 2022] PUT /identity/v3/projects/6ade4d59d3b249ba93f8ba5cf15d15a2/users/6b6952a41eff4aa7ba9cbabdb482ffd8/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:29.377506 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.388451 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb539-b3af-4238-add6-32f6290803ca admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.445444 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754f3a-e805-400b-99bc-591471be3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.445995 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754f3a-e805-400b-99bc-591471be3bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.446275 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754f3a-e805-400b-99bc-591471be3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.446546 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754f3a-e805-400b-99bc-591471be3bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.447177 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754f3a-e805-400b-99bc-591471be3bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.448789 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754f3a-e805-400b-99bc-591471be3bc7 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.458837 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1293/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:29.462607 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.472661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c2968-0aaf-41e3-a80e-c76a18ceab25 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.477773 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.478411 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.478696 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.478985 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] PATH_INFO: `/v3/projects/6ade4d59d3b249ba93f8ba5cf15d15a2/users/6b6952a41eff4aa7ba9cbabdb482ffd8/roles/987cfd6c90bf4abf93e401eacbd51c60` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.480857 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ade4d59d3b249ba93f8ba5cf15d15a2, user_id=6b6952a41eff4aa7ba9cbabdb482ffd8, role_id=987cfd6c90bf4abf93e401eacbd51c60)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.483552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.494171 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1297/2590] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:29 2022] PUT /identity/v3/projects/6ade4d59d3b249ba93f8ba5cf15d15a2/users/6b6952a41eff4aa7ba9cbabdb482ffd8/roles/987cfd6c90bf4abf93e401eacbd51c60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:29.505584 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.506138 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.506228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.533840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] MFA Rules not processed for user `6b6952a41eff4aa7ba9cbabdb482ffd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:29.535026 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:29.547194 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:29.603388 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1294/2591] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:29.613891 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:29.616290 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:29.794302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c02c-5df6-4f30-89a3-7b48191122d7 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:29.797797 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d42c56-d8ea-4917-889b-a2d212c20cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:29.798393 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d42c56-d8ea-4917-889b-a2d212c20cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:29.798668 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d42c56-d8ea-4917-889b-a2d212c20cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:29.798936 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d42c56-d8ea-4917-889b-a2d212c20cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:29.807788 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d42c56-d8ea-4917-889b-a2d212c20cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:29.809188 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d42c56-d8ea-4917-889b-a2d212c20cc9 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:29.818308 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1298/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:29.953344 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:30.016041 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e795-b605-4b6f-9d41-80b66355888c None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:30.020628 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:30.021763 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:30.022053 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:30.022331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] PATH_INFO: `/v3/users/2344db79e2a843aba5d00c3e444bf3b8` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:30.023452 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2344db79e2a843aba5d00c3e444bf3b8)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:30.025419 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:30.071927 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2344db79e2a843aba5d00c3e444bf3b8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.072567 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2344db79e2a843aba5d00c3e444bf3b8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.079529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2344db79e2a843aba5d00c3e444bf3b8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.080165 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2344db79e2a843aba5d00c3e444bf3b8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.087534 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2344db79e2a843aba5d00c3e444bf3b8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.105518 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1295/2593] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:29 2022] DELETE /identity/v3/users/2344db79e2a843aba5d00c3e444bf3b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:30.109994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:30.110302 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:30.110581 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:30.129363 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:30.131329 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:30.192501 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1299/2594] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:30.202833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:30.204253 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:30.237038 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:30.263921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7759-b330-4d50-9ecb-2cfc866b2632 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:30.267539 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:30.268134 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:30.268404 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:30.268668 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:30.278246 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:30.279654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:30.288910 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1296/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:30.554949 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:30.556418 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:30.568814 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f6fe-a5ed-46c8-a8a5-b00ee115343d None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:30.573475 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:30.574132 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:30.574405 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:30.574671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] PATH_INFO: `/v3/projects/fde98ac6167444fba33c5f2ee0e406bc` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:30.576221 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde98ac6167444fba33c5f2ee0e406bc)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:30.577673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:30.622021 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:30.623438 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde98ac6167444fba33c5f2ee0e406bc', 'request_id': 'req-850cdce9-dc16-4b80-b596-d00db0fde336'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.631798 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde98ac6167444fba33c5f2ee0e406bc', 'request_id': 'req-850cdce9-dc16-4b80-b596-d00db0fde336'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.638746 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde98ac6167444fba33c5f2ee0e406bc', 'request_id': 'req-850cdce9-dc16-4b80-b596-d00db0fde336'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.649769 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] The token cache is being invalidate because project fde98ac6167444fba33c5f2ee0e406bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:30.650063 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.650673 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.652249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1300/2596] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:30 2022] DELETE /identity/v3/projects/fde98ac6167444fba33c5f2ee0e406bc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:30.656193 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:30.666439 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd41c-7e9e-4690-ad14-08ebe39ee75e service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:30.719825 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:30.720434 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:30.720708 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:30.720976 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] PATH_INFO: `/v3/users/6b6952a41eff4aa7ba9cbabdb482ffd8` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:30.722103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6952a41eff4aa7ba9cbabdb482ffd8)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:30.723997 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:30.769987 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6952a41eff4aa7ba9cbabdb482ffd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.770655 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6952a41eff4aa7ba9cbabdb482ffd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.778195 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6952a41eff4aa7ba9cbabdb482ffd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.778815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6952a41eff4aa7ba9cbabdb482ffd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.786008 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-92bbf2e0-6f82-4d26-afd2-22eb3d4c761d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6952a41eff4aa7ba9cbabdb482ffd8'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:30.803277 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1297/2597] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:30 2022] DELETE /identity/v3/users/6b6952a41eff4aa7ba9cbabdb482ffd8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:31.072918 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.074364 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:31.087835 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdce9-dc16-4b80-b596-d00db0fde336 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.143248 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.143871 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.144145 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.144416 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] PATH_INFO: `/v3/projects/6ade4d59d3b249ba93f8ba5cf15d15a2` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.145517 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ade4d59d3b249ba93f8ba5cf15d15a2)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.148162 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.191919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ade4d59d3b249ba93f8ba5cf15d15a2', 'request_id': 'req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:31.197992 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ade4d59d3b249ba93f8ba5cf15d15a2', 'request_id': 'req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:31.205210 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ade4d59d3b249ba93f8ba5cf15d15a2', 'request_id': 'req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:31.216066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] The token cache is being invalidate because project 6ade4d59d3b249ba93f8ba5cf15d15a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:31.216354 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:31.216975 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-a5b0b6f8-4e8a-4f88-b385-97629cb5c8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:31.218463 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1301/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:31 2022] DELETE /identity/v3/projects/6ade4d59d3b249ba93f8ba5cf15d15a2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:31.224926 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.225184 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.225453 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.245907 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:31.247093 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:31.290204 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:31.305821 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1298/2599] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:31.313784 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.314066 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.314334 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.333252 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:31.335089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:31.342656 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1302/2600] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:31.346801 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.357331 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96eea-68b1-4325-a434-c17b45e94dff None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.362063 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.362665 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.362945 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.363216 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] PATH_INFO: `/v3/domains` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.363889 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 06:13:31.364191 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.365895 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.377315 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1299/2601] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 06:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 06:13:31.381957 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.391113 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385b271-8e4c-4bdf-ae33-7f3633219920 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.395818 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.396966 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.397281 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.397693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.398409 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.400234 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.426509 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1303/2602] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 06:13:31 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 06:13:31.431108 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.440975 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b2161-b517-4d23-9fbd-6eb1133d6414 admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.495848 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.496447 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.496727 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.497000 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] PATH_INFO: `/v3/users` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.497619 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.499560 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.520966 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1300/2603] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 06:13:31 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 06:13:31.525099 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.535044 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1734c7-4bf9-449f-8f6f-726c0348f9e6 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.540176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.540763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.541039 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.541306 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] PATH_INFO: `/v3/roles` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.542089 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.543677 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.553929 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1304/2604] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:31.557780 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.567529 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba5bc-50a8-4424-a110-9afc016b846c admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.572228 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a45d0-cc3e-4dc1-b706-9a9e5ac630f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.572817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a45d0-cc3e-4dc1-b706-9a9e5ac630f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.573094 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a45d0-cc3e-4dc1-b706-9a9e5ac630f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.573371 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a45d0-cc3e-4dc1-b706-9a9e5ac630f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.574073 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a45d0-cc3e-4dc1-b706-9a9e5ac630f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.575658 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a45d0-cc3e-4dc1-b706-9a9e5ac630f3 admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.586144 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1301/2605] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 06:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 06:13:31.590103 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.600353 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1fa69-b6a3-456f-8aa9-4825f28608da admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.604967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.605600 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.605931 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.606204 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] PATH_INFO: `/v3/projects/896f125f482444af8f76e030100e018a/users/3c3275acb5404f29abc50402dccee485/roles/ba67557ce74c431c93432833ee06b87f` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.620719 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896f125f482444af8f76e030100e018a, user_id=3c3275acb5404f29abc50402dccee485, role_id=ba67557ce74c431c93432833ee06b87f)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.623338 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.636546 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1305/2606] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 06:13:31 2022] PUT /identity/v3/projects/896f125f482444af8f76e030100e018a/users/3c3275acb5404f29abc50402dccee485/roles/ba67557ce74c431c93432833ee06b87f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:31.646817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373d5b7-48a8-4d2b-b25a-7470b7681dbb None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.647100 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373d5b7-48a8-4d2b-b25a-7470b7681dbb None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.647376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373d5b7-48a8-4d2b-b25a-7470b7681dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.674833 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-6373d5b7-48a8-4d2b-b25a-7470b7681dbb None None] MFA Rules not processed for user `3c3275acb5404f29abc50402dccee485`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:31.675973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6373d5b7-48a8-4d2b-b25a-7470b7681dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:31.738232 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1302/2607] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:31.750368 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:31.752033 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:31.757624 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:31.811968 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7180c3f-9d67-4365-b238-bef2663d48a4 admin admin] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:31.815601 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8203173f183e4494b580181cd3647e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:31.816202 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:31.816482 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:31.816754 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:31.825384 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:31.826838 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:31.835494 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1306/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:33.195480 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:33.196017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:33.196017 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:33.215245 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] MFA Rules not processed for user `3c3275acb5404f29abc50402dccee485`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:33.216425 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:33.223096 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1303/2609] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:35.710763 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:35.712134 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:35.778855 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049508-0101-4ab3-bba6-4d5f0ef39ef4 service cinder] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:35.783795 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:35.784396 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:35.784671 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:35.784939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:35.786680 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:35.798761 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:35.800324 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:35.810584 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1307/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:40.672260 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:40.673765 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:40.726120 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:40.744250 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89825ee3-5a1c-4740-8b63-6ff15b4492a0 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:40.747957 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:40.748564 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:40.748840 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:40.749208 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:40.750891 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:40.761386 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:40.762769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9b937-9dbc-4448-8228-3ed69fb1a192 service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:40.770896 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1304/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:45.806170 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=57 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:46.524532 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:46.525994 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:46.603776 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8a29b-86ac-4fae-8f2e-67a471aca353 service placement] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:46.609070 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6caa2ac059864911ac3d429df74b693e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:46.609669 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:46.609972 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:46.610238 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:46.611919 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:46.623757 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:46.625213 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:46.636403 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1308/2612] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:50.767530 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=8 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:51.400187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345d91-2ca1-4959-ae19-01687c59d372 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:51.400499 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345d91-2ca1-4959-ae19-01687c59d372 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:51.400773 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345d91-2ca1-4959-ae19-01687c59d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:51.459276 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-a4345d91-2ca1-4959-ae19-01687c59d372 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:51.461024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-a4345d91-2ca1-4959-ae19-01687c59d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:51.523921 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1305/2613] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:13:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:51.570269 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:51.571755 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:51.660599 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279414fc-dc8a-4f5a-ae91-76b953cdd119 service nova] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:51.665623 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:51.666249 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:51.666528 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:51.666805 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:51.674693 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:51.676263 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:51.684559 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1309/2614] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:13:52.176982 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8137ae-dfa7-455b-b3d2-10e550039452 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:52.177456 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8137ae-dfa7-455b-b3d2-10e550039452 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:52.177566 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8137ae-dfa7-455b-b3d2-10e550039452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:52.197598 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4c8137ae-dfa7-455b-b3d2-10e550039452 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:52.198805 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4c8137ae-dfa7-455b-b3d2-10e550039452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:52.205817 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1306/2615] 10.222.0.16 () {58 vars in 967 bytes} [Thu Oct 20 06:13:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:52.217853 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:52.228215 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c3ae2-c70f-486d-9e92-689a52a8b92f service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:52.233071 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:52.233661 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:52.233967 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:52.234239 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:52.242552 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:52.244114 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:52.251907 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1310/2616] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:13:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:13:52.470535 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ec22-0af4-4d41-b9b0-a84e5c4d8a5f None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:52.470815 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ec22-0af4-4d41-b9b0-a84e5c4d8a5f None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:52.471091 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ec22-0af4-4d41-b9b0-a84e5c4d8a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:52.490996 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4675ec22-0af4-4d41-b9b0-a84e5c4d8a5f None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:52.492243 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4675ec22-0af4-4d41-b9b0-a84e5c4d8a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:52.499103 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1307/2617] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 06:13:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 06:13:52.511458 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:52.521760 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944e7d-9c43-4c33-8ec3-9990b2c1800f service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:52.527176 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:52.527756 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:52.528057 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:52.528341 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:52.535999 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:52.537537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:52.545336 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1311/2618] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:13:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:13:52.869059 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] REQUEST_METHOD: `POST` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:52.869350 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:52.869626 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:52.889503 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.auth.core [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] MFA Rules not processed for user `3f8de808ec41406bbde9e63a6a212f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:52.890755 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:52.898001 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1308/2619] 10.222.0.16 () {58 vars in 967 bytes} [Thu Oct 20 06:13:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:13:52.909660 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:52.920172 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394221-df4d-43f3-832d-236b17900048 service swift] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:52.924923 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945698-b3fb-48fe-9f78-0f61dbd4d9ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7643a92cc44ea8b718a4f8532105ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:52.925502 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945698-b3fb-48fe-9f78-0f61dbd4d9ab service swift] REQUEST_METHOD: `GET` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:52.925801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945698-b3fb-48fe-9f78-0f61dbd4d9ab service swift] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:52.926073 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945698-b3fb-48fe-9f78-0f61dbd4d9ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:52.934997 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945698-b3fb-48fe-9f78-0f61dbd4d9ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:52.936556 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945698-b3fb-48fe-9f78-0f61dbd4d9ab service swift] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:52.944436 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1312/2620] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Oct 20 06:13:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 06:13:55.196473 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:55.258973 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27db93-cd64-4294-811a-eb2ff96a8ab2 None None] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:55.263402 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:55.264024 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:55.264304 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:55.264576 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] PATH_INFO: `/v3/users/3c3275acb5404f29abc50402dccee485` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:55.265699 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3275acb5404f29abc50402dccee485)` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:55.267654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:55.311187 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:55.312744 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3275acb5404f29abc50402dccee485'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.313550 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3275acb5404f29abc50402dccee485'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.322111 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3275acb5404f29abc50402dccee485'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.322749 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3275acb5404f29abc50402dccee485'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.329654 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.notifications [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3275acb5404f29abc50402dccee485'} {{(pid=81425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.347196 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1309/2621] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 06:13:55 2022] DELETE /identity/v3/users/3c3275acb5404f29abc50402dccee485 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:13:55.352772 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] REQUEST_METHOD: `POST` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:55.353257 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:55.353358 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:55.371887 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.auth.core [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] MFA Rules not processed for user `b0376d5185ac4115b7c02b4f3223cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 06:13:55.373074 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:55.382203 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=100 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:55.431981 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1313/2622] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 06:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 06:13:55.441509 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:55.442940 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:55.498899 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6b39-baab-4117-a67f-b82aed815a2a admin admin] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:55.502455 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b3ec9b66547c0afce59fe21c5feb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:55.503045 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:55.503321 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:55.503585 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:55.512581 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:55.514046 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:55.523302 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1310/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:13:55.693125 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] Authenticating user token {{(pid=81424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:13:55.694770 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.fernet_utils [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:13:55.707068 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4e414-1644-4e93-9815-8b1378e87050 None None] Validating token access rules against request {{(pid=81424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:13:55.712284 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0376d5185ac4115b7c02b4f3223cf16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e0c1ea686742ad9b5478d4dbdbb4cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:13:55.712922 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:13:55.713201 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:13:55.713468 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] PATH_INFO: `/v3/projects/896f125f482444af8f76e030100e018a` {{(pid=81424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:13:55.714643 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896f125f482444af8f76e030100e018a)` {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:13:55.716537 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] RBAC: Authorization granted {{(pid=81424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:13:55.764939 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896f125f482444af8f76e030100e018a', 'request_id': 'req-28f0088e-db44-4af5-996b-7786c5357023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.770969 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896f125f482444af8f76e030100e018a', 'request_id': 'req-28f0088e-db44-4af5-996b-7786c5357023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.778766 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896f125f482444af8f76e030100e018a', 'request_id': 'req-28f0088e-db44-4af5-996b-7786c5357023'} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.789801 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] The token cache is being invalidate because project 896f125f482444af8f76e030100e018a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 06:13:55.790090 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.790714 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG keystone.notifications [None req-28f0088e-db44-4af5-996b-7786c5357023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 06:13:55.792164 dv-cinder-861566-3-smb devstack@keystone.service[81424]: [pid: 81424|app: 0|req: 1314/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 06:13:55 2022] DELETE /identity/v3/projects/896f125f482444af8f76e030100e018a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 06:14:05.519090 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:05.786243 dv-cinder-861566-3-smb devstack@keystone.service[81424]: DEBUG dbcounter [-] [81424] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:14.628307 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] Authenticating user token {{(pid=81425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 06:15:14.629822 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:15:14.696769 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49e1f-daff-4da0-92a0-4af5d430c82d service neutron] Validating token access rules against request {{(pid=81425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 06:15:14.753474 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd277333a752f4bfea444af9ed1a7a5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2849c247210d4893bfbaba6bbc95e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 06:15:14.754163 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] REQUEST_METHOD: `GET` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 06:15:14.754441 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 06:15:14.754711 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 06:15:14.756670 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.fernet_utils [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 06:15:14.768376 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 06:15:14.769974 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f587c-735e-4e70-942c-64f55c2f15d4 service placement] RBAC: Authorization granted {{(pid=81425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 06:15:14.779667 dv-cinder-861566-3-smb devstack@keystone.service[81425]: [pid: 81425|app: 0|req: 1311/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 06:15:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 06:15:24.775450 dv-cinder-861566-3-smb devstack@keystone.service[81425]: DEBUG dbcounter [-] [81425] Writing DB stats keystone:SELECT=58 {{(pid=81425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}